liveBook · Manning

Capsule network

As explained in Sutskever's List

A capsule network is a neural architecture that represents entities with groups of units called capsules and models relationships among their properties.

A capsule network is a neural architecture that groups units into capsules representing entities and models relationships among their properties. Geoffrey Hinton introduced the approach in 2017 as a possible alternative to convolutional neural networks, aiming to add reasoning about entities within images. section 7.6

An elegant idea meets the benchmark

Capsule networks reached state-of-the-art results on smallNORB and came close on MNIST, but their training and scaling difficulties prevented them from matching leading CNNs on CIFAR and ImageNet. They became a cautionary example of why an appealing architectural idea still needs competitive empirical results. section 7.6

How Sutskever's List covers it

How deep it goes
Defines the architectural motivation and reports benchmark outcomes, but does not explain capsule mechanics or training procedures.
Examples
Uses smallNORB, MNIST, CIFAR, and ImageNet to contrast capsule performance with leading CNN results.
What you can do after
Evaluate capsule networks by comparing their conceptual promise, training difficulty, scalability, and benchmark performance.
How it connects
Connects capsules to convolutional neural networks, image reasoning, and empirical benchmarking.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Sutskever's List. The section links point to the parts of the book it draws on.