Evaluation escalation routes an example from a cheap Tier 1 judge to a stronger judge or human reviewer instead of accepting the first verdict. It concentrates expensive review on cases that signal uncertainty, but cannot reliably catch confidently wrong judgments. section 10.5.2
Common escalation triggers include:
- A borderline score, such as 3 on a five-point scale when 3 separates pass from fail. section 10.5.2
- High variance across repeated samples, indicating an unstable judgment. section 10.5.2
- Position sensitivity revealed by a swapped-order test. section 10.5.2
- Explicitly low confidence reported by the Tier 1 judge. section 10.5.2
The confident fabrication
A judge may accept a fabricated figure because fluent surrounding prose makes the answer appear reliable. If it remains confident and consistent, escalation thresholds never route the example upward. section 10.5.2
