Verbosity bias occurs when an LLM judge rewards a longer answer because it seems more complete, thoughtful, or polished—not because it is more accurate or useful. A concise response may better serve the user. Reduce the bias by separating completeness from length in the rubric, rewarding direct answers and necessary information, and penalizing unsupported elaboration. section 9.7.2
A less length-biased rubric
Instead of asking “Which response is more helpful?”, ask whether each response answers directly, avoids unnecessary detail, and includes only information needed for the task. section 9.7.2

