verbosity bias
/vərˈbɒsəti ˈbaɪəs/
a judge's tendency to score longer answers higher regardless of quality
verbosity bias in a sentence
“Controlling for verbosity bias flipped the leaderboard.”
Origin of verbosity bias
Latin verbosus wordy + Old French biais oblique
Related Words
evals
systematic tests to measure model performance on specific tasks
LLM-as-a-Judge
using a strong LLM to evaluate the outputs of another model
ground truth
the actual absolute truth or correct answer used for comparison
tracing
recording the flow of execution and data through a complex system
hallucination rate
the frequency with which a model generates incorrect information
benchmark
a standardized test used to compare performance