liveBook · Manning

Probability theory

As explained in Machines that Think

Probability is a mathematical measure of the likelihood of events or outcomes.

Probability describes how strongly a language model favors token sequences given their preceding context. Training rewards predicting continuations that resemble its data, so probability reflects learned patterns—not whether a claim matches external facts. section 6.1.2

When context strongly matches learned patterns, outputs often align with known information. With weak or ambiguous matches, several continuations may compete; the model may still choose the likeliest rather than signal uncertainty, producing plausible but unsupported claims. section 6.1.2

Figure 6.1 Models learn patterns from training data and extend them to new cases. In this example, animals associated with water are often labeled as fish. When no clear example is available, as with the dolphin, the model does not stop or admit uncertainty. It continues by extending the strongest available pattern, incorrectly classifying the dolphin as a fish rather than a mammal.

The dolphin example illustrates how a model can extend a strong pattern—associating water animals with fish—even when that pattern leads to an incorrect answer. section 6.1.2

How Machines that Think covers it

How deep it goes
Traces token-sequence probability from training objectives to hallucination without developing a formal mathematical account.
Examples
Uses a dolphin mislabeled as a fish when water-associated patterns dominate.
What you can do after
Evaluate why a likely continuation can sound plausible without being factually verified.
How it connects
Connects probability to language-model training, next-token prediction, hallucination, and uncertainty.

Also explained in

Compare how 22 books explain probability theory →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machines that Think. The section links point to the parts of the book it draws on.