benchmark
/ˈbentʃmɑːrk/
a standardized test used to compare performance
benchmark in a sentence
“MMLU is a popular benchmark for general knowledge.”
Origin of benchmark
Surveying term; a surveyor's mark on a stone
Related Words
golden dataset
a hand-verified set of examples used as the standard for judging model output
rubric
an explicit scoring guide that turns judgment into repeatable criteria
pass@k
the probability that at least one of k sampled attempts is correct
drift
gradual change in inputs or behavior that quietly erodes performance
error analysis
systematically reading failures to find the patterns worth fixing
perplexity
a measure of how surprised a model is by text; lower means better prediction