| item ^ |
priority ^ |
status ^ |
notes ^ |
| Benchmark job created without a testplan has no plot link |
medium |
defer |
If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
| support phase reordering |
low |
defer |
May be useful for LAVA integration (don't want to run pre_test before build) |
| have test do description-setting |
low |
defer |
Should be possible using Jenkins cli - there's a command to set a job description |
| ov_transport_connect/ov_transport_disconnect |
high |
defer |
Sounds like Jan-Simon will do it |
| get rid of nbench-bytes |
medium |
defer |
This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
| web file transport |
low |
defer |
could be useful for some interesting target cases |
| support separate build phase |
medium |
defer |
don't want to hold board reserved during build, for lava integration and handling timeouts better |
| handle set -e differently |
medium |
defer |
handle script errors explicitly, instead of relying on shell |
| handle timeouts automatically |
medium |
defer |
should be in test and board, not in plan - but depends on spec, transport, build time etc |
| automatically create a view for each board |
medium |
defer |
use a command line option on fuego-create-node (--make_view) |
| fix ftc device dictionary |
medium |
defer |
used for board check and pre-populating options |
| item ^ |
priority ^ |
status ^ |
notes ^ |
| support ftc run-test |
low |
done |
BUILD_TIMESTAMP won't work with separate post_test, but we're not doing that |
| make sure benchmarks produce their res.json files |
high |
open |
I can't find any on April 4 |
| Benchmark job created without a testplan has no plot link |
medium |
defer |
If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
| Update wiki documentation for this release |
high |
done |
In partcular, update the screenshots |
| rename all scripts to fuego_test.sh |
low |
closed |
Instead, Daniel renamed all scripts to match test base name |
| support phase reordering |
low |
defer |
May be useful for LAVA integration (don't want to run pre_test before build) |
| fix OpenSSL test |
medium |
done |
OpenSSL uses a common script, not functional.sh or benchmark.sh |
| have test do description-setting |
low |
defer |
Should be possible using Jenkins cli - there's a command to set a job description |
| ov_transport_connect/ov_transport_disconnect |
high |
defer |
Sounds like Jan-Simon will do it |
| get rid of nbench-bytes |
medium |
defer |
This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
| add node and job scripts to ftc |
high |
done |
This is now integrated into ftc |
| add testplan_smoketest |
low |
done |
This is used in the Fuego_Quickstart_Guide |
| use spec name instead of plan name in job name |
medium |
done |
Use <board>.<spec>.<testname> |
| eliminate DISTRIB |
medium |
done |
automatically detect, and use board vars |
| web file transport |
low |
defer |
could be useful for some interesting target cases |
| testing by Jan-Simon |
high |
closed |
don't know availability |
| support separate build phase |
medium |
defer |
don't want to hold board reserved during build, for lava integration and handling timeouts better |
| handle set -e differently |
medium |
defer |
handle script errors explicitly, instead of relying on shell |
| ensure logs are linked even for failed tests |
high |
done |
if log exists, there should be link, failure or not |
| testing by Daniel |
high |
done |
is testing week of April 3 |
| add back ttc support |
high |
done |
it looks like it was completely ripped out of Daniel's code |
| fix LTP |
high |
open |
make sure LTP works for docker and bbb |
| put post_test process kill in test_cleanup |
high |
done |
need optional test_cleanup, that calls kill_procs, that calls ov_rootfs_kill |
| fix netperf |
medium |
done |
netperf uses a common script, not functional.sh or benchmark.sh |
| handle timeouts automatically |
medium |
defer |
should be in test and board, not in plan - but depends on spec, transport, build time etc |
| move /fuego-ro/conf/boards to /fuego-ro/boards |
medium |
done |
simplifies access to boards |
| automatically create a view for each board |
medium |
defer |
use a command line option on fuego-create-node (--make_view) |
| fix ftc device dictionary |
medium |
defer |
used for board check and pre-populating options |
| item ^ |
priority ^ |
status ^ |
notes ^ |
| support ftc run-test |
low |
done |
BUILD_TIMESTAMP won't work with separate post_test, but we're not doing that |
| make sure benchmarks produce their res.json files |
high |
open |
I can't find any on April 4 |
| Benchmark job created without a testplan has no plot link |
medium |
defer |
If you create a Benchmark job (say Benchmark.fuego_check_plots) using ftc add-jobs -b docker -t Benchmark.fuego_check_plots -s default, then build page for this job will have no link to plot.png |
| Update wiki documentation for this release |
high |
done |
In partcular, update the screenshots |
| rename all scripts to fuego_test.sh |
low |
closed |
Instead, Daniel renamed all scripts to match test base name |
| support phase reordering |
low |
defer |
May be useful for LAVA integration (don't want to run pre_test before build) |
| fix OpenSSL test |
medium |
done |
OpenSSL uses a common script, not functional.sh or benchmark.sh |
| have test do description-setting |
low |
defer |
Should be possible using Jenkins cli - there's a command to set a job description |
| ov_transport_connect/ov_transport_disconnect |
high |
defer |
Sounds like Jan-Simon will do it |
| get rid of nbench-bytes |
medium |
defer |
This is a dumb duplicate of nbench_bytes (see Fuego naming rules) |
| add node and job scripts to ftc |
high |
done |
This is now integrated into ftc |
| add testplan_smoketest |
low |
done |
This is used in the Fuego_Quickstart_Guide |
| use spec name instead of plan name in job name |
medium |
done |
Use <board>.<spec>.<testname> |
| eliminate DISTRIB |
medium |
done |
automatically detect, and use board vars |
| web file transport |
low |
defer |
could be useful for some interesting target cases |
| testing by Jan-Simon |
high |
closed |
don't know availability |
| support separate build phase |
medium |
defer |
don't want to hold board reserved during build, for lava integration and handling timeouts better |
| handle set -e differently |
medium |
defer |
handle script errors explicitly, instead of relying on shell |
| ensure logs are linked even for failed tests |
high |
done |
if log exists, there should be link, failure or not |
| testing by Daniel |
high |
done |
is testing week of April 3 |
| add back ttc support |
high |
done |
it looks like it was completely ripped out of Daniel's code |
| fix LTP |
high |
open |
make sure LTP works for docker and bbb |
| put post_test process kill in test_cleanup |
high |
done |
need optional test_cleanup, that calls kill_procs, that calls ov_rootfs_kill |
| fix netperf |
medium |
done |
netperf uses a common script, not functional.sh or benchmark.sh |
| handle timeouts automatically |
medium |
defer |
should be in test and board, not in plan - but depends on spec, transport, build time etc |
| move /fuego-ro/conf/boards to /fuego-ro/boards |
medium |
done |
simplifies access to boards |
| automatically create a view for each board |
medium |
defer |
use a command line option on fuego-create-node (--make_view) |
| fix ftc device dictionary |
medium |
defer |
used for board check and pre-populating options |