An ideal response is the reference answer used to judge whether a generated reply is appropriate, factual, complete, on-brand, and consistent with the virtual agent’s purpose and persona. section 4.4.4
Create an ideal response by:
- Reviewing each generated answer against defined quality dimensions. section 4.4.4
- Replacing weak outputs with factual and complete reference answers, then pairing each answer with its test utterance. section 4.4.4
- Saving the pairs in a testing-tool format so they can support baseline measurement, prompt tuning, and LLM configuration. section 4.4.4
A useful reference answer
For “Can I bring a snowboard on my flight as checked baggage?”, an ideal response specifies the one-bag requirement, equipment limits, and overweight-fee condition instead of giving a vague yes or no.
