Robustness is whether a system continues to make reasonable, defensible decisions as inputs and context vary. Accurate answers can still fail users when irrelevant input changes the system’s response. section 6.1.2
Two demonstrated ways robustness can fail are:
- Phrasing changes, such as swapping “car” for “vehicle,” can shift confidence enough to flip borderline decisions. section 6.1.2
- Different dialects or underrepresented languages can receive lower-quality answers despite expressing the same intent, creating a fairness concern. section 6.1.2
A corrupted attachment derails an answer
A speck of dirt on a scanned insurance page produced incomprehensible OCR text. ClaimAssist then changed topic and gave accurate but irrelevant policy information. Testing paraphrases with Giskard or adversarial cases with ART can help probe robustness before deployment. section 6.1.2 section 1.5











