Sequential evaluation assesses each quality dimension in a separate judge call. Focusing on one aspect at a time can improve attention and supports prompts specialized for different criteria. section 4.4.3
Use sequential evaluation when:
- Quality dimensions interact in complex ways. section 4.4.3
- Different dimensions need specialized prompts. section 4.4.3
- You can accept cost increasing proportionally with the number of dimensions. section 4.4.3
Customer-service response
Evaluate helpfulness, factual accuracy, tone, and policy compliance through separate judge calls, using a prompt optimized for each dimension. section 4.4.3
