liveBook · Manning

Generalization

As explained in Knowledge Graphs and LLMs in Action

Generalization is the process of deriving a broader model or conclusion that applies beyond the observed examples.

Generalization transforms individual examples into a broader model that applies to unseen cases. In learning systems, it distinguishes genuine learning from memorizing previously observed examples. section 2.4

Use the distinction between memorization, induction, and deduction to assess reasoning behavior:

  • A memorizing spam filter matches new messages only against stored examples, so it cannot reliably classify messages that differ from them. section 2.4
  • Inductive reasoning infers broad conclusions from specific observations, but those conclusions can be false even when the observations are true. section 2.4
  • Deductive reasoning applies a general hypothesis to reach a specific conclusion, assuming its premises are correct. section 2.4

Email spam classification

A learning-based spam filter should label unseen emails using patterns derived from labeled messages, rather than rerouting only exact matches found in a knowledge base. section 2.4

How Knowledge Graphs and LLMs in Action covers it

How deep it goes
Defines generalization through spam filtering and contrasts inductive and deductive reasoning, without detailing model-training internals.
Examples
Uses spam filtering, unseen emails, labeled messages, coins, and bald grandfathers to illustrate generalization and its risks.
What it assumes
Assumes familiarity with labeled examples and basic reasoning, while defining inductive and deductive reasoning through concrete cases.
What you can do after
Evaluate/understand whether a system learns patterns for unseen cases or only retrieves previously stored examples.
How it connects
Connects generalization with inductive reasoning, deductive reasoning, machine learning, and knowledge bases.

Also explained in

Compare how 13 books explain generalization →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Knowledge Graphs and LLMs in Action. The section links point to the parts of the book it draws on.