A source of truth is the authoritative context or information an output must conform to. In model alignment, a written specification serves this role: its clauses define expected behavior for both training and evaluation. section 8.4.4
Make the source of truth operational by:
- Translating each specification clause into a test prompt with a known expected behavior. section 8.4.4
- Running the resulting evaluation suite whenever the model, specification, or deployment changes. section 8.4.4 section 8.5.4
- Versioning the specification and tying every deployed model to the version used for training. section 8.5.4
- Turning every production failure into either additional training data for an existing clause or a new clause. section 8.5.4
Financial research assistant
Require the assistant to cite the source paragraph for every numerical claim and say “I don’t know” when the answer is absent from retrieved context. Test each rule automatically, then block deployment when the suite fails. section 8.4.4
The same pattern applies to closed-domain generation: the provided context is the source of truth, and faithfulness checks determine whether an answer stays grounded before other quality dimensions are scored. section 5.5












