Self-enhancement bias occurs when an evaluator favors outputs that resemble its own characteristic style, structure, tone, or reasoning. A judge may reward polished formatting, confident phrasing, or familiar reasoning even when the underlying answer is not better. The risk is greatest when comparing different model families or prompting styles: stylistic alignment can be mistaken for task quality. section 9.7.3
Reduce self-enhancement bias by making evaluation criteria harder to substitute with stylistic preference:
- Specify task success, factual support, policy compliance, and user usefulness before considering tone or presentation. section 9.7.3
- Define good style explicitly when style is genuinely part of the product requirement. section 9.7.3
- Use debate-style judging to build a case for each response before weighing them, interrupting first-impression shortcuts and rationalization. section 10.3.3
- For stronger isolation, use separate advocate calls for each response and a final judge call that compares the completed arguments. section 10.3.3
Comparing concise and explanatory answers
A crisp response and a more verbose response may both satisfy the task. If the judge naturally favors crisp, confident phrasing, it can select the first because it resembles its familiar style rather than because it is more useful. A task-focused rubric should therefore assess success and support before presentation. section 9.7.3
Debate-style evaluation
A single judging call argues for Response A, argues for Response B, weighs both cases, and then returns a verdict. A multi-call version assigns each response to an isolated advocate before a third call judges the finished arguments. The latter costs more but limits one call's ability to favor familiar phrasing while constructing both sides. section 10.3.3

