reference.log

Note: This file is deprecated. It is replaced by the file criteria.json, which now holds the benchmark measurement threshold and operator.

Each section in the reference.log file has a threshold specifier, which consists of 2 lines:

The metric operator line specifies the name of the metric, a vertical bar ('|'), and either 'ge' or 'le', all inside square brackets.

The threshold value is a numeric value to compare the benchmark result with, to indicate success or failure.

Example:

This file is read by parser.py to check the metrics against each declared threshold, to determine pass or fail for benchmark tests.

See also parser.py, Benchmark parser notes, and bench_processing