liveBook · Manning

Learning system

As explained in Machines that Think

A computational system whose behavior or capabilities are acquired from experience rather than specified entirely by explicit instructions.

A learning system acquires behavior from experience rather than relying entirely on instructions that specify what to do. It still executes fixed procedures, but learned parameters can change how it responds. As a result, it can produce appropriate outputs that its designers did not explicitly program or fully anticipate. section 1.3.5

Neural networks illustrate this distinction. They improve by modifying internal connections in response to experience, gradually learning patterns and representations. With sufficient data, computing power, and training methods, a network can extract increasingly abstract features, such as edges, shapes, and objects. Earlier efforts were constrained by scarce data, slow computers, and fragile training methods. section 1.4.3

Unexpected behavior is not necessarily random or arbitrary: it can be a consequence of applying learned patterns to a task. Generalizing beyond training data also demonstrates a form of abstraction, but observable performance alone does not establish awareness or human-like understanding. section 1.3.5 section 1.6.2

Biological constraints suggest additional questions for designing learning systems:

  • How can learning remain stable when feedback is sparse, delayed, or noisy? section 5.3.5
  • How can a system remain reliable despite noise, damage, or partial loss? section 5.3.5
  • How can adaptation continue alongside perception and action without erasing what the system already knows? section 5.3.5

These constraints help reveal design choices about feedback, robustness, and adaptation; they do not provide a blueprint for a thinking machine. More broadly, learning-based systems offer a way to investigate whether capabilities associated with cognition can grow from experience rather than explicit instruction. section 5.3.5 section 1.6.1

How Machines that Think covers it

How deep it goes
Explains learned parameters, scaling constraints, and biological design pressures at an overview level, without implementation details.
Examples
Uses large language models and neural networks learning edges, shapes, and objects to illustrate learned behavior and representations.
What you can do after
Evaluate/understand learning systems by distinguishing adaptive performance from evidence of awareness and considering feedback, robustness, and retention constraints.
How it connects
Connects learning systems to neural networks, generalization, abstraction, continual learning, and adaptive control.

Also explained in

Compare how 2 books explain learning system →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machines that Think. The section links point to the parts of the book it draws on.