A blind audit sample routes a fixed random share of high-confidence Tier 1 judgments to Tier 2 or a human reviewer without relying on Tier 1's uncertainty. It exposes confident errors that uncertainty-based escalation systematically misses. section 10.5.2
Implement the audit path as a separate, predictable measurement channel:
- Select a fixed random percentage of Tier 1's high-confidence verdicts. section 10.5.2
- Send those cases to Tier 2 or a human reviewer independently of Tier 1's confidence. section 10.5.2
- Track Tier 1–reviewer disagreements as a separate confident-error rate. section 10.5.2
- Treat a rising rate as an early signal that the cheaper judge has drifted beyond its competence on a traffic slice. section 10.5.2
