Test output format
This page is about the output from the test programs, not the output from Fuego itself. For that, see the Unified Results Format Project.
Candidate formats are:
- json - using a schema similar to what kernelci use
- TAP - test anything protocol
- *unit - for the xunit, junit, pyunit family of test frameworks
- are these are consistent in their output?
Here are projects that promote or use a single test output format:
- https://testanything.org/ (Test Anything Protocol)
Notes on these:
Ptest normally uses the test suite that comes with the original source code. For example, for the openssh recipe it uses some of the tests inside openssh's "regress" folder.
However, there are many recipes without their corresponding ptest definitions. I'm not sure if that is just because nobody added them yet, or because there was no test suite in the original source code.
TAP version 13 1..6 # # Create a new Board and Tile, then place # the Tile onto the board. # ok 1 - The object isa Board ok 2 - Board size is zero ok 3 - The object isa Tile ok 4 - Get possible places to put the Tile not ok 5 - Placing the tile produces no error --- message: Could not place tile at row 1, column 1 severity: fail ... ok 6 - Board size is 1