An input/output validation layer sanitizes requests and responses before they reach an external LLM API. When the vendor operates it, the layer forms a trust boundary: organizations typically cannot directly enforce or change its rules, so they must assess how well it detects prompt injections, harmful content, accidental data leakage, and hallucinations. section 2.2
Assess vendor controls and compensate for gaps:
- Request documentation of validation processes; ask how prompt injection and harmful content are detected, and how related logs are used and retained. section 2.2
- Where vendor controls fall short, add safeguards such as internal review, clear user warnings, or customized guardrails. section 2.2
