flatten nested lists in ShellCommands commands=..

[mmadia]

The following usage of properties={},Property() will not work as expected.

master.cfg:

BuildSlave("my-build-slave", "my-password", 
	properties={ 'configure':'--use-gcc-pipe --use-xattr' })
#....
fX86Quick.addStep(ShellCommand(
	command=[
		'../../haiku/configure',
		Property('configure'),
		'--cross-tools-prefix',
		'../../cross-tools-x86gcc2/cross-tools/bin/i586-pc-haiku-'],
	description="Configuring X86 GCC 2 normal with cross-tools-prefix",
	name="Configure cross-tools-prefix x86gcc2"))

logs/stdio

../../haiku/configure '--use-gcc-pipe --use-xattr' --cross-tools-prefix ../../cross-tools-x86gcc2/cross-tools/bin/i586-pc-haiku-
 in dir /storage/public/mmadia-buildbot-exp/sandbox/slave/x86gcc2-quick/build (timeout 1200 secs)
 watching logfiles {}
 argv: ['../../haiku/configure', '--use-gcc-pipe --use-xattr', '--cross-tools-prefix', '../../cross-tools-x86gcc2/cross-tools/bin/i586-pc-haiku-']
 environment:
<snip>
  SHELL=/usr/local/bin/bash
<snip>
 using PTY: False
Invalid argument: `--use-gcc-pipe --use-xattr'
program finished with exit code 1
elapsedTime=0.008083

[dustin]

I would begin testing this by using something like this in your master.cfg:

factory.addStep(ShellCommand(command=['trial', ['-d', '-B'], 'pyflakes']))

and see how it fails - in particular, it tries to pass "['-d', '-B']" as an argument, which trial doesn't recognize.

Then, look at master/buildbot/test/unit/test_steps_shell.py, and add a unit test that produces the same error.

Then, fix the problem, by flattening the nested lists -- and see both the unit test and your master.cfg start working properly.

Then, make things a little more complex - add tests with two nested lists, or lists nested two-deep, or an empty nested list, or whatever you can think of - and make sure that the step does the right thing.

Finally, add a sentence to the documentation for ShellCommand so that others expect this behavior.

[ewong]

Patch to fix ticket.

[Dustin J. Mitchell]

Flatten lists in shell commands, so that properties can insert multiple args

Patch by Edmund Wong <ewong@…>.

Fixes #2150.

Changeset: 726e9f81c103939d22bd18d53ca65c66cfb8aed7

[Dustin J. Mitchell]

release notes and docs - Refs #2150.

Changeset: 745c1e528e178b3685933a7f24c4bd42792421e2