reference.log
Note: This file is deprecated. It is replaced by the file criteria.json, which now holds the benchmark measurement threshold and operator.
Each section in the reference.log file has a threshold specifier, which consists of 2 lines:
- [metric operator]
- threshold value
The metric operator line specifies the name of the metric, a vertical bar ('|'), and either 'ge' or 'le', all inside square brackets.
The threshold value is a numeric value to compare the benchmark result with, to indicate success or failure.
Example:
[SciMark.FFT|ge] 0 [SciMark.LU|ge] 0
This file is read by parser.py to check the metrics against each declared threshold, to determine pass or fail for benchmark tests.
See also parser.py, Benchmark parser notes, and bench_processing