Release 1.1 To Do

priorities for 1.1 release [edit section]

What's left to do [edit section]

item  ^ priority  ^ status  ^ notes  ^
make sure benchmarks produce their res.json files high open I can't find any on April 4
fix LTP high open make sure LTP works for docker and bbb
Edit the data below.

Stuff that got deferred [edit section]

item  ^ priority  ^ status  ^ notes  ^
ov_transport_connect/ov_transport_disconnect high defer Sounds like Jan-Simon will do it
get rid of nbench-bytes medium defer This is a dumb duplicate of nbench_bytes (see Fuego naming rules)
handle set -e differently medium defer handle script errors explicitly, instead of relying on shell
Benchmark job created without a testplan has no plot link medium defer If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png
automatically create a view for each board medium defer use a command line option on fuego-create-node (--make_view)
support separate build phase medium defer don't want to hold board reserved during build, for lava integration and handling timeouts better
fix ftc device dictionary medium defer used for board check and pre-populating options
handle timeouts automatically medium defer should be in test and board, not in plan - but depends on spec, transport, build time etc
web file transport low defer could be useful for some interesting target cases
have test do description-setting low defer Should be possible using Jenkins cli - there's a command to set a job description
support phase reordering low defer May be useful for LAVA integration (don't want to run pre_test before build)
Edit the data below.

Full table [edit section]

item  ^ priority  ^ status  ^ notes  ^
add node and job scripts to ftc high done This is now integrated into ftc
ov_transport_connect/ov_transport_disconnect high defer Sounds like Jan-Simon will do it
ensure logs are linked even for failed tests high done if log exists, there should be link, failure or not
make sure benchmarks produce their res.json files high open I can't find any on April 4
add back ttc support high done it looks like it was completely ripped out of Daniel's code
fix LTP high open make sure LTP works for docker and bbb
testing by Daniel high done is testing week of April 3
put post_test process kill in test_cleanup high done need optional test_cleanup, that calls kill_procs, that calls ov_rootfs_kill
testing by Jan-Simon high closed don't know availability
Update wiki documentation for this release high done In partcular, update the screenshots
get rid of nbench-bytes medium defer This is a dumb duplicate of nbench_bytes (see Fuego naming rules)
handle set -e differently medium defer handle script errors explicitly, instead of relying on shell
fix netperf medium done netperf uses a common script, not functional.sh or benchmark.sh
eliminate DISTRIB medium done automatically detect, and use board vars
Benchmark job created without a testplan has no plot link medium defer If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png
automatically create a view for each board medium defer use a command line option on fuego-create-node (--make_view)
move /fuego-ro/conf/boards to /fuego-ro/boards medium done simplifies access to boards
use spec name instead of plan name in job name medium done Use <board>.<spec>.<testname>
fix OpenSSL test medium done OpenSSL uses a common script, not functional.sh or benchmark.sh
support separate build phase medium defer don't want to hold board reserved during build, for lava integration and handling timeouts better
fix ftc device dictionary medium defer used for board check and pre-populating options
handle timeouts automatically medium defer should be in test and board, not in plan - but depends on spec, transport, build time etc
rename all scripts to fuego_test.sh low closed Instead, Daniel renamed all scripts to match test base name
web file transport low defer could be useful for some interesting target cases
have test do description-setting low defer Should be possible using Jenkins cli - there's a command to set a job description
support ftc run-test low done BUILD_TIMESTAMP won't work with separate post_test, but we're not doing that
add testplan_smoketest low done This is used in the Fuego_Quickstart_Guide
support phase reordering low defer May be useful for LAVA integration (don't want to run pre_test before build)

Data [edit section]

Edit the data here:
item  ^ priority  ^ status  ^ notes  ^
testing by Daniel high done is testing week of April 3
testing by Jan-Simon high closed don't know availability
put post_test process kill in test_cleanup high done need optional test_cleanup, that calls kill_procs, that calls ov_rootfs_kill
handle set -e differently medium defer handle script errors explicitly, instead of relying on shell
use spec name instead of plan name in job name medium done Use <board>.<spec>.<testname>
handle timeouts automatically medium defer should be in test and board, not in plan - but depends on spec, transport, build time etc
support separate build phase medium defer don't want to hold board reserved during build, for lava integration and handling timeouts better
support phase reordering low defer May be useful for LAVA integration (don't want to run pre_test before build)
fix ftc device dictionary medium defer used for board check and pre-populating options
eliminate DISTRIB medium done automatically detect, and use board vars
support ftc run-test low done BUILD_TIMESTAMP won't work with separate post_test, but we're not doing that
ensure logs are linked even for failed tests high done if log exists, there should be link, failure or not
have test do description-setting low defer Should be possible using Jenkins cli - there's a command to set a job description
ov_transport_connect/ov_transport_disconnect high defer Sounds like Jan-Simon will do it
web file transport low defer could be useful for some interesting target cases
rename all scripts to fuego_test.sh low closed Instead, Daniel renamed all scripts to match test base name
add node and job scripts to ftc high done This is now integrated into ftc
automatically create a view for each board medium defer use a command line option on fuego-create-node (--make_view)
move /fuego-ro/conf/boards to /fuego-ro/boards medium done simplifies access to boards
fix LTP high open make sure LTP works for docker and bbb
fix netperf medium done netperf uses a common script, not functional.sh or benchmark.sh
fix OpenSSL test medium done OpenSSL uses a common script, not functional.sh or benchmark.sh
get rid of nbench-bytes medium defer This is a dumb duplicate of nbench_bytes (see Fuego naming rules)
add back ttc support high done it looks like it was completely ripped out of Daniel's code
make sure benchmarks produce their res.json files high open I can't find any on April 4
add testplan_smoketest low done This is used in the Fuego_Quickstart_Guide
Benchmark job created without a testplan has no plot link medium defer If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png
Update wiki documentation for this release high done In partcular, update the screenshots
Query