liveBook · Manning

Human-in-the-loop

As explained in AI Agents and Applications

Human-in-the-loop is a system pattern in which people provide input, judgment, review, or intervention within an automated process.

An AI agent can assemble a travel plan, but it should not always finalize one on its own. Human oversight adds a review point: the agent pauses so a person can validate a proposed response or approve a critical action before it proceeds. The same pattern applies to financial transactions and complex medical recommendations. section 1.1.3

Escalate when automated handling is not enough, for example:

  • An unusual itinerary has uncertain safety, feasibility, or timing. section 14.3.2
  • Severe weather, a transport strike, or a cancellation calls for up-to-date judgment. section 14.3.2
  • An accessibility or accommodation request needs details confirmed with a provider. section 14.3.2

For an operational workflow, route high-value transactions, sensitive-data access, or uncertain decisions to an operator for approval before execution. Log approvals and rejections. Those decisions can help refine automated thresholds; patterns in reviews can also inform guardrails, prompts, and knowledge bases, reducing future escalations. section 14.4 section 14.3.2

Oversight complements rather than replaces other safeguards. Retrieval-augmented generation (RAG) can ground an answer in retrieved context, while prompts, guardrails, and validators constrain or check it. When the stakes are high, a person can still review the answer before it reaches the user. section 1.4.2

How AI Agents and Applications covers it

How deep it goes
Describes escalation triggers, approval, and feedback logging, but stops short of a concrete human-review implementation.
Examples
Uses itinerary approval, travel disruptions, accessibility requests, financial transactions, and medical recommendations as review cases.
What you can do after
Operate/configure it by escalating selected cases for approval and logging decisions to improve future automated handling.
How it connects
Connects human review to AI agents, guardrails, RAG, prompts, and automated decision thresholds.

Also explained in

Compare how 17 books explain human-in-the-loop →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of AI Agents and Applications. The section links point to the parts of the book it draws on.