Inconsistency occurs when different users receive different answers to the same question on different days, even when the answers draw on the same policy documents. Unlike robustness failures caused by phrasing variation within one session, this cross-user variation can be harder to detect. section 6.1.2
Treat inconsistency as a risk to reduce and make traceable:
- Use layered controls to lower how often failures occur. section 6.8
- Log system behavior so failures can be reconstructed when they occur. section 6.8
Different answers to the same policy question
Two users ask the same question on different days and receive different answers from a system using the same policy documents. This is a consistency problem, not merely a response to different phrasing. section 6.1.2
