In an agent pipeline, routing can direct rigid JSON-generation requests from a costly external frontier API to a self-hosted specialized small language model, with an API fallback. section 12.0
Reduce the risk of replacing the established API by shadowing live traffic: test the candidate model while users continue receiving API responses, then validate cost, latency, and reliability. section 12.0

































