liveBook · Manning

Chapter 1: Foundations of self-improving agents

What you will learn in chapter 1 of Self-Improving Agents

The introduction explains why production agents need ongoing improvement and presents a self-run improvement loop that does not retrain the underlying model.

After this chapter you will be able to

Section by section

Introduction

The introduction explains why production agents need ongoing improvement and presents a self-run improvement loop that does not retrain the underlying model.

Key terms: use cases, production, iteration, improvement loop, underlying model

1.1 What a self-improving agent is

This section previews a review of the agent and its surrounding harness, followed by an explanation of self-improvement.

1.1.1 Defining the agent and the scaffolding

Defines an agent in relation to its supporting harness and explains why improving an agent may include improving that harness.

Key terms: agent, harness, scaffolding, model, self-improvement, agent tasks

1.1.2 The self-improving agent

This section contrasts manual, feedback-driven agent fixes with a self-improving agent that evaluates outputs, searches for improvements to its agent and harness, and proposes changes while humans retain deployment oversight.

Key terms: self-improving agent, harness, underlying model, user feedback, prompt/context, redeploy, unversioned, signal, structured, repeatable evaluation, deploy gate

1.1.3 Why the model never changes

The section explains why a self-improving agent improves its shared infrastructure and artifacts rather than changing the frozen model.

Key terms: infrastructure intelligence, individual intelligence, collective intelligence, frozen model, agent context instructions, harness, artifacts

1.2 The improvement loop

Introduces the recurring loop in which an agent’s measured result can prompt a search for an improvement that is applied back to the agent.

Key terms: agentic self-improvement, loop, search for improvement

1.2.1 The loop, walked through one task

A support-agent example shows how an offline improvement loop judges an answer, selects a better prompt, and deploys it without changing the model.

Key terms: act, signal, search, apply, deploy gate, offline, LLM-as-Judge, rubric, gap, prompt variants

1.2.2 The three dials

This section identifies three independent dials of the improvement loop and explains why a score alone does not constitute self-improvement.

Key terms: signal, search, artifact, gap, variant, three dials, artifact dial, prompt, memory, self-evaluation

1.2.3 Online and offline: where the loop runs

This section contrasts online and offline versions of the same improvement loop, explaining how the deployment gate affects safety, feedback, and the kinds of changes each version can make.

Key terms: offline, online, deployment gate, signal, search, artifacts, prompts, memory, scaffolds, code

1.3 The four kinds of things the loop can improve

This section introduces artifacts as the pieces an improvement loop replaces with better versions.

Key terms: artifact, text artifact (context)

1.3.1 What an artifact is

Defines the editable, tracked artifacts an improvement loop can change, distinguishes them from excluded internals, and explains why artifact layers can overlap.

Key terms: artifact, harness, candidate version, rollback-able, LLM weights, activations, internal states, external loop, layers, code layer

1.3.2 The four layers and the toolkit that runs them

This section classifies editable agent artifacts by how deeply they change the harness, explains how the layers compose and differ in risk, and distinguishes them from the layer-zero toolkit that runs improvement.

Key terms: L1, text or context layer, tool descriptions, skill files, L2, memory layer, L3, metacognitive layer, scaffold, L4

1.4 The signal and search families behind the loop

Introduces the distinct roles of signal and search in the improvement loop.

Key terms: signal, search, gap, L0 toolkit

1.4.1 The signal family

This section compares three families of improvement signals, explains the tradeoff between their precision and availability, and shows why signal quality limits improvement.

Key terms: signal, precision, availability, gap, ground-truth signal, environment signal, labelled dataset, judge-based signal, absolute scoring, pairwise preference

1.4.2 The search family

This section compares five families of search methods by what they search, how they explore, and the effort they require, then explains how to choose and apply them across artifacts.

Key terms: search, signal, candidate variants, hill-climbing, local peak, pairwise and population methods, reinforcement-learning searches, policy, episodic memory, tool selection

1.5 Summary

The chapter summary contrasts manual agent improvement with a closed self-improvement loop and recaps the harness artifacts, signals, and searches that make the loop possible.

Where this is used later

Concepts explained in this chapter

Chapter 2: Getting started improving agents →

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.