Tier 2 is the expensive, low-volume evaluator in a tiered judging system. A fast Tier 1 judge handles every example, while Tier 2 re-evaluates cases that the first pass cannot resolve confidently. section 10.5.1
Route an example upward when the first evaluator signals uncertainty through:
- A borderline score near the pass/fail threshold. section 10.5.2
- High score variance across repeated evaluations. section 10.5.2
- Position sensitivity revealed by swapping item order. section 10.5.2
- An explicitly reported low-confidence verdict. section 10.5.2
A limitation of confidence-based routing
A Tier 1 judge may confidently accept a fabricated figure when fluent surrounding prose makes the answer appear credible. Because the verdict is neither borderline nor low-confidence, it never reaches Tier 2. Tiering therefore concentrates stronger evaluation on visible uncertainty but can miss confidently consistent errors. section 10.5.2
