reference set
/ˈrefərəns set/
a curated collection of test inputs and trusted expectations used for evaluation
reference set in a sentence
“The reference set included routine requests, ambiguous cases, and known past failures.”
Origin of reference set
Latin referre to carry back + Old English settan to place
Related Words
evaluation baseline
a simple or established result used as the comparison point for a new approach
model regression
a decline in behavior that previously worked after a model, prompt, tool, or system changes
drift
gradual change in inputs, outputs, or conditions that can reduce system performance over time
error analysis
the systematic inspection and classification of failures to identify patterns and fixes
judge bias
a systematic preference in a human or model evaluator that distorts scores independently of quality
hallucination
fluent model output that is false, unsupported, or inconsistent with the supplied evidence