liveBook · Manning

Agent orchestration

As explained in Designing AI Systems

The coordination of agent steps, tools, models, and state to complete a multi-step task.

Agent orchestration is a GenAI infrastructure layer for applications involving multi-step reasoning and external tool integration. It sits alongside context assembly, session memory, and real-time knowledge ingestion—capabilities that add production complexity beyond a model API call. section 1.2.2

Figure 1.2 The GenAI Infrastructure Explosion. The model API call now represents just 2% of total system complexity—even less than in traditional ML. Modern GenAI applications require vastly expanded infrastructure: knowledge management systems, safety and compliance layers, session management for conversations, tool integration platforms, advanced observability, and multi-provider model orchestration. This architectural shift explains why simple prototypes become complex production systems.

The infrastructure diagram shows how model calls fit within the broader set of systems required by production GenAI applications. section 1.2.2

How Designing AI Systems covers it

How deep it goes
Identifies agent orchestration as an infrastructure layer but does not specify its internal design or implementation.
Examples
Contrasts a minimal model API call with the broader infrastructure required by production GenAI applications.
How it connects
Connects agent orchestration with real-time knowledge ingestion, context assembly, session memory, and AI-specific governance.

Also explained in

Compare how 19 books explain agent orchestration →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Designing AI Systems. The section links point to the parts of the book it draws on.