liveBook · Manning

Agent harness

As explained in Self-Improving Agents

Software scaffolding that surrounds an agent and provides its supporting execution environment.

An agent can give a poor answer even when its underlying model stays the same. The prompt, tool access, or software running its task loop may be the part that needs work. An agent harness is that supporting software: the scaffolding around the model that helps an agent perform tasks. An agent is the task-performing system formed by a model running within a configured harness; a harness can also contain multiple agents. section 1.1.1 section 1.1.2

Figure 1.1 The harness and the agent shows the boundary and purpose for the harness with respect to the agent worker.

The diagram locates the harness around the agent worker and shows its relationship to the LLM and tool calls. section 1.1.1

The harness is also a place to improve an agent without changing model weights. Its editable infrastructure includes text, memory, metacognitive scaffolds, and code or tools. A self-improvement loop acts, measures a signal, searches for a better variant, and applies it. Measuring alone is not improvement: a candidate change still needs evaluation and an apply step. Changes can be versioned and rolled back; offline improvements pass through deployment review. section 1.5 section 1.1.3

One edit, many running instances

Imagine a thousand support conversations, each handled by an agent instance using the same frozen model and shared prompt. Edit one sentence of that prompt. On their next requests, the instances use the revised instruction; none has learned through a weight update. The change lives in shared infrastructure, so its effect should be checked before treating it as an improvement. section 1.1.3 section 1.5

How Self-Improving Agents covers it

How deep it goes
Defines its boundary against agents and LLMs and mentions tool calls and task loops, without specifying a harness implementation.
Examples
Illustrates shared infrastructure with a thousand concurrent support-agent conversations using a revised prompt on their next requests.
What it assumes
Assumes familiarity with production agents and prompts while defining the harness and its relationship to the model.
What you can do after
Evaluate/understand whether an agent change belongs in editable harness infrastructure rather than model weights.
How it connects
Connects the harness to LLMs, tool calls, agentic loops, structured evaluation, and editable artifacts.

Also explained in

Compare how 4 books explain agent harness →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Self-Improving Agents. The section links point to the parts of the book it draws on.