Confident-error rate measures how often a lower-tier judge's high-confidence verdict disagrees with an independent stronger evaluation. It exposes blind spots that uncertainty-based escalation cannot see. section 10.5.2
Use it as a deliberate audit signal:
- Route a fixed random percentage of high-confidence lower-tier verdicts to a stronger tier or human reviewer, then count disagreements. section 10.5.2
- Interpret a rising rate as evidence that the cheaper judge has drifted beyond its competence on some traffic slice. section 10.5.2
- Keep the sample independent of the lower-tier judge's uncertainty; otherwise the metric cannot reveal confident mistakes. section 10.5.2
