Intent-based routing classifies a user’s request and dispatches it to the downstream model or agent suited to handle it. Because a wrong route can produce a wrong answer regardless of downstream quality, routing accuracy deserves focused measurement. section 8.3.8
Use a measured progression when introducing routing:
- Start with a frontier model for routing when accuracy matters across diverse inputs. section 8.3.8
- Consider a routing-specific small language model only after measuring its quality against the frontier-model baseline. section 8.3.8
- Track cost per session, resolved task, and user before optimizing routing or other cost levers. section 8.3.8
