liveBook · Manning

Abstraction

As explained in Deep Learning with R, Third Edition

An abstraction is a compact, reusable representation of underlying structures, principles, or invariants extracted from experience or data.

An abstraction is a compact, reusable idea drawn from experience. Instead of storing every situation separately, you identify what several situations have in common. When something unfamiliar appears, you can combine those ideas to make sense of it. A jet plane, for example, might initially look like a large metal bird that does not flap its wings. section 19.3.2 section 19.3.1

Recognizing a new beetle

Suppose you have seen many beetles. You can group similar ones and form a prototype for each group: a representation of shared features, not a copy of any individual beetle. A new beetle can then be compared with the prototypes rather than every beetle you have encountered. section 19.4.1

Two kinds of comparison produce different abstractions:

  • Value-centric abstraction groups instances by degrees of similarity, as with the beetle prototypes. It supports approximate recognition and intuition. section 19.4.1 section 19.4.2
  • Program-centric abstraction looks for exact structural matches across instances. It isolates shared structures and supports more exact reasoning and planning. section 19.4.1 section 19.4.2
Table 19.1 The two poles of abstraction
Value-centric abstraction
Program-centric abstraction
Relates things by distance
Relates things by exact structural match
Continuous, grounded in geometry
Discrete, grounded in topology
Produces abstractions by “averaging” instances into “prototypes”
Produces abstractions by isolating isomorphic substructures across instances
Underlies perception and intuition
Underlies reasoning and planning
Immediate, fuzzy, approximative
Slow, exact, rigorous
Requires a lot of experience to produce reliable results
Experience-efficient; can operate on as few as two instances

Compare the two poles side by side: their matching rules, resulting abstractions, and roles in perception or reasoning differ, but the two work together. section 19.4.2

Acquiring abstractions is only half the job. Recombining them for a new problem helps explain extreme generalization: dealing with situations far from past experience, sometimes with little new data. Classic deep learning can acquire useful patterns during training, but its trained mapping mainly supports local generalization near familiar inputs; it does not recombine what it knows on the fly at test time. section 19.3.2 section 19.2.2

How Deep Learning with R, Third Edition covers it

How deep it goes
Defines acquisition and recombination, compares two forms of abstraction, and identifies a deep-learning limitation without providing an implementation.
Examples
Illustrates abstraction with beetle prototypes and analogies such as describing a jet plane as a metal bird.
What it assumes
Starts with familiar comparisons and concrete categories before distinguishing similarity from exact structural matching.
What you can do after
Evaluate/understand why similarity-based recognition differs from structural reasoning and why familiar-input performance does not guarantee adaptation to novelty.
How it connects
Connects abstraction to analogy, clustering, reasoning, planning, local generalization, and extreme generalization.

Also explained in

Compare how 15 books explain abstraction →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Deep Learning with R, Third Edition. The section links point to the parts of the book it draws on.