liveBook · Manning

Convolutional neural network

As explained in Grokking Machine Learning

A neural-network architecture that uses convolutional operations to learn localized and hierarchical patterns, especially in structured data such as images.

How can a neural network recognize a face without flattening an image into a featureless list of pixels? A convolutional neural network (CNN) preserves local structure by moving a small window, such as 5-by-5 or 7-by-7 pixels, across a larger image and applying a convolution at each position. This helps learn localized and hierarchical patterns in complicated images. section 10.5

Use CNNs for image tasks such as:

  • Image recognition, where an image produces a label. section 10.5
  • Semantic segmentation, where an image produces labels and bounded locations for detected objects. section 10.5
  • More complicated pictures and faces, where flattening an image loses important information. section 10.5

Datasets to try

MNIST contains 28-by-28 grayscale handwritten digits; CIFAR-10 contains 32-by-32 color images with ten labels; CIFAR-100 uses similar images with one hundred labels. section 10.5

How Grokking Machine Learning covers it

How deep it goes
Explains the sliding-window convolution intuition but stops short of a complete implementation or formal derivation.
Examples
Uses MNIST, CIFAR-10, CIFAR-100, complicated pictures, and faces as image examples.
What it assumes
Assumes familiarity with neural networks and fully connected image classification while motivating CNNs from their limitations.
What you can do after
Evaluate when convolutional architectures better preserve useful image information than fully connected networks.
How it connects
Connects convolutional neural networks with neural networks, fully connected networks, image recognition, and semantic segmentation.

Also explained in

Compare how 18 books explain convolutional neural network →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Grokking Machine Learning. The section links point to the parts of the book it draws on.