liveBook · Manning

Connectionism

As explained in Sutskever's List

Connectionism is the view that intelligence emerges from learned patterns of activity in interconnected neural units.

Connectionism holds that intelligence emerges from learned statistical regularities and distributed representations in interconnected neural units, rather than from explicitly programmed symbolic rules. section 7.6

Its central dispute with GOFAI concerns compositionality: critics argue that learned patterns must explain structured thought, while connectionists argue that symbolic-like competence can emerge from lower-level soft constraints. section 7.6

From philosophical wager to benchmark

The Malik–Hinton wager shifted attention from claims about neural networks to measured performance. PASCAL and ImageNet provided shared tests, while AlexNet supplied a concrete breakthrough for convolutional networks. section 7.6 section 7.6

How Sutskever's List covers it

How deep it goes
Explains core assumptions, compositionality criticism, and benchmark validation, but stops short of neural implementation details.
Examples
Uses PASCAL, ImageNet, AlexNet, and the Malik–Hinton wager to illustrate empirical evaluation.
What you can do after
Evaluate learned representations by comparing measured benchmark gains against strong baselines.
How it connects
Connects connectionism to symbolic AI, distributed representations, gradient-based learning, compositionality, and neural networks.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.