liveBook · Manning

Router

A router is a component that directs an incoming request or task to a destination or processing path according to routing criteria.

How 2 Manning books explain it

Rearchitecting LLMs

A request router is a component that directs incoming requests to an appropriate processing queue or model configuration.

How it is used
Directs requests to adapter queues or fallback APIs and assigns token-level computation to mixture-of-experts specialists.
How deep it goes
Develops routing from linear projections through training, top-k selection, inspection, and deployment trade-offs.
Examples
Uses clinical extraction and general-knowledge prompts to inspect expert weights, alongside a confidence-gated API fallback.
What you can do after
Builds and evaluates a trainable MoE router, including top-k inference and token-level routing inspection.

Read how Rearchitecting LLMs explains router →

Context Engineering

A routing agent analyzes an incoming query and directs it to a specialized retrieval tool or knowledge store.

How it is used
Routes requests to specialized agents or retrieval destinations as part of context orchestration.
How deep it goes
Explains state-based classification and conditional graph branches, then recommends confidence thresholds and explicit fallbacks for production.
Examples
Uses a customer support workflow with sales, technical support, and general agents.
What you can do after
Apply it via LangGraph to dispatch support questions through conditional branches.

Read how Context Engineering explains router →

Also covered in

What to know first

Related concepts

Questions about router

What is router?

A router is a component that directs an incoming request or task to a destination or processing path according to routing criteria.

Which Manning books explain router?

Rearchitecting LLMs and Context Engineering.

What should I know before learning router?

Manning books that teach router usually introduce subagent, context window, retrieval-augmented generation and prompt first.

What kinds of router are there?

Kinds of router include ensemble router, multi-layered router and proximity router.

What is router part of?

Router is part of mixture of experts. A mixture-of-experts model is a neural-network architecture with specialized subnetworks and a routing mechanism that selects or combines experts for each input.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.