drift
/drɪft/
gradual change in inputs or behavior that quietly erodes performance
drift in a sentence
“Monitoring caught the drift when user queries shifted to a new product line.”
Origin of drift
Old Norse drift snowdrift, from drifa to drive
Related Words
error analysis
systematically reading failures to find the patterns worth fixing
perplexity
a measure of how surprised a model is by text; lower means better prediction
benchmark saturation
when models max out a test so it can no longer tell them apart
observability
the degree to which a system's inner behavior can be inferred from what it emits
verbosity bias
a judge's tendency to score longer answers higher regardless of quality
evals
systematic tests to measure model performance on specific tasks