liveBook · Manning

Abstraction & Reasoning Corpus for Artificial General Intelligence

As explained in Sutskever's List

ARC-AGI is a benchmark of small grid-based puzzles that evaluates abstract rule induction from a few examples.

ARC-AGI is a benchmark of small grid-based puzzles designed to test whether a system can infer an abstract rule from a few examples and apply it to a new grid. It places symbolic reasoning and learned neural representations under the same empirical test: success depends less on philosophical claims about intelligence than on measured performance against a shared task. section 7.6

ARC-AGI sits at the intersection of two views of reasoning:

  • Symbolic approaches specify rules explicitly, offering compositional structure but risking brittleness when real-world details or grounding are underspecified. section 7.6
  • Connectionist approaches learn distributed representations from data; their challenge is explaining compositional, rule-like behavior without prespecifying every rule. section 7.6

How Sutskever's List covers it

How deep it goes
Frames the symbolic-connectionist reasoning debate but does not detail ARC task-solving algorithms or implementations.
Examples
Uses small grid-based puzzles requiring a rule inferred from a few training examples.
What you can do after
Evaluate claims about reasoning by comparing systems on shared abstraction tasks and measured baselines.
How it connects
Connects abstract reasoning with symbolic systems, connectionism, compositionality, inductive bias, and neural networks.

Also explained in

Compare how 3 books explain Abstraction & Reasoning Corpus for Artificial General Intelligence →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.