Note: This file is deprecated. It is replaced by the file criteria.json, which now holds the benchmark measurement threshold and operator.
Each section in the reference.log file has a threshold specifier, which consists of 2 lines:
- [metric operator]
- threshold value
The metric operator line specifies the name of the metric, a vertical bar ('|'), and either 'ge' or 'le', all inside square brackets.
The threshold value is a numeric value to compare the benchmark result with, to indicate success or failure.
This file is read by parser.py to check the metrics against each declared threshold, to determine pass or fail for benchmark tests.