reference.log in split format
Note: This file is deprecated. It is replaced by the file criteria.json, which now holds the benchmark measurement threshold and operator. | ''Note: This file is deprecated. It is replaced by the file [[criteria.json]], which now holds the benchmark measurement threshold and operator. |
Each section in the reference.log file has a threshold specifier, which consists of 2 lines: * [metric operator] * threshold value | Each section in the reference.log file has a threshold specifier, which consists of 2 lines: * [metric operator] * threshold value |
The metric operator line specifies the name of the metric, a vertical bar ('|'), and either 'ge' or 'le', all inside square brackets. | The metric operator line specifies the name of the metric, a vertical bar ('|'), and either 'ge' or 'le', all inside square brackets. |
The threshold value is a numeric value to compare the benchmark result with, to indicate success or failure. | The threshold value is a numeric value to compare the benchmark result with, to indicate success or failure. |
Example: {{{#!YellowBox [SciMark.FFT|ge] 0 [SciMark.LU|ge] 0 }}} | Example: {{{#!YellowBox [SciMark.FFT|ge] 0 [SciMark.LU|ge] 0 }}} |
This file is read by parser.py to check the metrics against each declared threshold, to determine pass or fail for benchmark tests. | This file is read by parser.py to check the metrics against each declared threshold, to determine pass or fail for benchmark tests. |
See also parser.py, Benchmark parser notes, and bench_processing | See also [[parser.py]], [[Benchmark parser notes]], and [[function_bench_processing|bench_processing]] |