liveBook · Manning

Auxiliary classifier

As explained in Math and Architectures of Deep Learning

An extra intermediate classifier attached to a deep network to provide additional training signals to earlier layers.

An auxiliary classifier is an extra prediction head attached to an intermediate layer of a deep network. In GoogLeNet, softmax predictions from two intermediate Inception modules receive losses against the ground truth, helping prevent the middle layers from dying under vanishing gradients. section 11.2.2

GoogLeNet loss

GoogLeNet combines the main classification loss with the two auxiliary losses as a weighted sum: total loss = real loss + weighted auxiliary losses. The classifiers are attached within a 22-layer network, counted as 27 layers when pooling layers are included. section 11.2.2

Figure 11.8 Inception_v1 architecture

Use the Inception_v1 architecture diagram to locate the intermediate modules that feed auxiliary classifiers and the final classifier. section 11.2.2

How Math and Architectures of Deep Learning covers it

How deep it goes
Explains placement, softmax prediction, ground-truth loss, and weighted loss combination, but defers original-paper details.
Examples
Uses GoogLeNet’s two intermediate classifiers and its weighted combination of auxiliary and final losses.
What you can do after
Evaluate/understand how intermediate supervision supports gradient flow in a deep Inception-based classifier.
How it connects
Connects auxiliary classifiers to GoogLeNet, Inception modules, softmax, cross-network loss, and vanishing gradients.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Math and Architectures of Deep Learning. The section links point to the parts of the book it draws on.