A deterministic metric applies fixed, rule-based calculations to produce a crisp result from valid inputs. It works best when an output can be reduced to a binary or bounded outcome, making the signal interpretable and statistically convenient. section 9.2
Use deterministic metrics as a dependable baseline when:
- The task supports exact matching, labels, rule-based checks, or trusted ground truth. section 9.11
- You need benchmarking, regression testing, or sanity checks with repeatable numeric signals. section 9.2
- You want measures such as accuracy, recall, precision, or precision@K rather than interpretive judgments. section 9.2 section 9.1
The trade-off is coverage. A single deterministic metric cannot represent the factual accuracy, logical coherence, relevance, tone, safety, usefulness, or intent alignment of open-ended outputs. It can also penalize multiple valid answers that differ in form. Keep these metrics as a foundation, then add qualitative evaluation when the product signal is semantic, contextual, or subjective. section 9.2 section 9.0
A conversational response
Accuracy or precision can provide a crisp signal for a bounded prediction, but they cannot by themselves determine whether an empathetic conversational response is helpful, coherent, appropriately toned, safe, or a creative valid alternative. That boundary indicates when a deterministic baseline needs a complementary evaluation method. section 9.2
