liveBook · Manning

Non-monotonic reasoning

As explained in Sutskever's List

Non-monotonic reasoning is inference in which newly added information can invalidate or revise conclusions drawn from earlier assumptions.

A familiar river-crossing plan can fail after one small change: the boat still holds two people, but one person cannot row. Non-monotonic reasoning treats the original plan as provisional. When the new constraint rules out a crossing, the solver must revise the plan rather than preserve it. section 7.5.1

This distinction exposes a weakness in script-based problem solving. A language model may continue the standard crossing sequence and add explanations that make it sound plausible. The account can be rhetorically consistent while its actions remain illegal. The practical test is whether the changed constraint alters the plan itself. section 7.5.1

ARC-AGI extends the challenge to small grid puzzles. Introduced by François Chollet in 2019, it asks a solver to infer a rule from only a few examples and apply it to a new case. Strong performance on one set of puzzles does not settle whether that ability generalizes: gains on ARC-AGI-1 were followed by sharply lower performance on ARC-AGI-2. Revising an inference when the task demands it remains more important than fitting a familiar pattern. section 7.6

How Sutskever's List covers it

How deep it goes
Explains revision through a crossing-plan failure, without specifying a formal inference procedure or implementation.
Examples
Illustrates revision with a non-rower in a river-crossing puzzle and rule inference with ARC-AGI grid puzzles.
What you can do after
Evaluate/understand whether a solver changes an invalid plan instead of merely explaining it away.
How it connects
Connects provisional strategies to distributional brittleness and ARC-AGI’s few-example abstraction tests.

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.