Release 1.2 To Do
priorities for 1.2 release [edit section]
What's left to do [edit section]
item ^ | priority ^ | status ^ | notes ^ |
Update wiki documentation for this release | high | open | In particular, update information about results files, main.sh, spec file format, testplan defaults |
support LAVA transport | high | open | Required for AGL/JTA integration |
support AGL/JTA reports | high | open | Song Cai is interested in this work |
get rid of nbench-bytes | medium | open | This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
support unified output format | high | open | create results.json files for all tests (including functional tests) see Unified_Results_Format_Project |
fix LTP | high | open | make sure LTP works for docker and bbb |
automatically create a view for each board | medium | open | use a command line option on fuego add-nodes (--make_view) |
Stuff that got deferred [edit section]
item ^ | priority ^ | status ^ | notes ^ |
Benchmark job created without a testplan has no plot link | medium | defer | If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
support phase reordering | low | defer | May be useful for LAVA integration (don't want to run pre_test before build) |
web file transport | low | defer | could be useful for some interesting target cases |
support separate build phase | medium | defer | don't want to hold board reserved during build, for lava integration and handling timeouts better |
handle set -e differently | medium | defer | handle script errors explicitly, instead of relying on shell |
handle timeouts automatically | medium | defer | should be in test and board, not in plan - but depends on spec, transport, build time etc |
Full table [edit section]
item ^ | priority ^ | status ^ | notes ^ |
Benchmark job created without a testplan has no plot link | medium | defer | If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
Update wiki documentation for this release | high | open | In particular, update information about results files, main.sh, spec file format, testplan defaults |
support phase reordering | low | defer | May be useful for LAVA integration (don't want to run pre_test before build) |
support LAVA transport | high | open | Required for AGL/JTA integration |
support AGL/JTA reports | high | open | Song Cai is interested in this work |
ov_transport_connect/ov_transport_disconnect | high | closed | Sounds like Jan-Simon will do it |
get rid of nbench-bytes | medium | open | This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
modify ftc run-test for base script calling convention | high | closed | call main.sh instead of base script, and set TESTDIR and TESTNAME |
web file transport | low | defer | could be useful for some interesting target cases |
support unified output format | high | open | create results.json files for all tests (including functional tests) see Unified_Results_Format_Project |
support separate build phase | medium | defer | don't want to hold board reserved during build, for lava integration and handling timeouts better |
handle set -e differently | medium | defer | handle script errors explicitly, instead of relying on shell |
fix LTP | high | open | make sure LTP works for docker and bbb |
handle timeouts automatically | medium | defer | should be in test and board, not in plan - but depends on spec, transport, build time etc |
automatically create a view for each board | medium | open | use a command line option on fuego add-nodes (--make_view) |
fix ftc device dictionary | medium | closed | used for board check and pre-populating options |
Data [edit section]
Edit the data here:item ^ | priority ^ | status ^ | notes ^ |
Benchmark job created without a testplan has no plot link | medium | defer | If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
Update wiki documentation for this release | high | open | In particular, update information about results files, main.sh, spec file format, testplan defaults |
support phase reordering | low | defer | May be useful for LAVA integration (don't want to run pre_test before build) |
support LAVA transport | high | open | Required for AGL/JTA integration |
support AGL/JTA reports | high | open | Song Cai is interested in this work |
ov_transport_connect/ov_transport_disconnect | high | closed | Sounds like Jan-Simon will do it |
get rid of nbench-bytes | medium | open | This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
modify ftc run-test for base script calling convention | high | closed | call main.sh instead of base script, and set TESTDIR and TESTNAME |
web file transport | low | defer | could be useful for some interesting target cases |
support unified output format | high | open | create results.json files for all tests (including functional tests) see Unified_Results_Format_Project |
support separate build phase | medium | defer | don't want to hold board reserved during build, for lava integration and handling timeouts better |
handle set -e differently | medium | defer | handle script errors explicitly, instead of relying on shell |
fix LTP | high | open | make sure LTP works for docker and bbb |
handle timeouts automatically | medium | defer | should be in test and board, not in plan - but depends on spec, transport, build time etc |
automatically create a view for each board | medium | open | use a command line option on fuego add-nodes (--make_view) |
fix ftc device dictionary | medium | closed | used for board check and pre-populating options |