liveBook · Manning

Routing

As explained in Financial AI in Practice

Model routing is the process of directing requests to different models according to their characteristics or requirements.

Model routing directs requests to different generative AI models based on task needs. In finance, a smart gateway can send simple, low-risk requests to a smaller, cheaper model and reserve a top-tier model for premium features or complex tasks requiring higher quality. section 3.4.2

Use routing to match model cost and capability to the request:

  • Send simple, low-risk requests to a smaller, cheaper model. section 3.4.2
  • Reserve top-tier models for premium features or complex tasks that demand the highest quality. section 3.4.2

How Financial AI in Practice covers it

How deep it goes
Defines tier selection by request simplicity, risk, and quality needs but leaves routing logic and implementation unspecified.
Examples
Contrasts routing simple, low-risk requests to cheaper models with reserving top-tier models for premium or complex tasks.
What you can do after
Apply it via a smart gateway that sends requests to model tiers based on task demands.
How it connects
Connects generative AI cost optimization with usage caps, caching, and prompt audits.

Also explained in

Compare how 22 books explain routing →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Financial AI in Practice. The section links point to the parts of the book it draws on.