liveBook · Manning

Multistep test

As explained in AI Governance

Multi-step testing evaluates intermediate actions and interactions in an agent workflow as well as its final outputs.

An agent can pass a final-output check while taking harmful or unauthorized steps along the way. Multi-step testing probes intermediate actions and interactions, then measures how errors propagate through the workflow. section 6.7.1

A practical testing and monitoring pattern:

  • Probe different steps with wrong or unexpected inputs; test agent interactions and the whole system when agents collaborate. section 6.7.1
  • Measure error propagation, and scale testing and online monitoring to the risks of the agent. section 6.7.1
  • Add programmatic runtime checks that halt the workflow when an unauthorized tool call is attempted. section 6.7.1
  • For long-running agents, track intent across steps rather than judging each action in isolation. section 6.7.1

How AI Governance covers it

How deep it goes
Describes step-level probes, error propagation, runtime checks, and risk-scaled monitoring without specifying a test suite.
Examples
Uses wrong or unexpected inputs, multi-agent interactions, and unauthorized tool calls as test targets.
What you can do after
Evaluate agent workflows by testing intermediate steps, measuring error propagation, and checking for unauthorized tool calls.
How it connects
Connects end-to-end testing with multi-agent systems, runtime monitoring, and unauthorized tool-call checks.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of AI Governance. The section links point to the parts of the book it draws on.