liveBook · Manning

End-to-end learning

As explained in Timeless Algorithms, The Foundational Ideas

End-to-end learning is an approach in which a single objective guides the joint learning of parameters throughout a model.

End-to-end learning trains a neural network by using one loss function to guide joint adjustments to parameters throughout the network, including those that form internal representations. section 11.2

Training links prediction to parameter updates:

  • A forward pass transforms inputs through successive layers to produce a prediction. section 11.2
  • A loss measures prediction error; backpropagation computes gradients for weights and biases, and an optimizer uses them to update parameters. section 11.2
  • After training, producing a prediction requires only the forward pass. section 11.2

Inputs, outputs, and losses

Inputs may be pixels, sensor readings, customer features, or word embeddings. Networks can predict a continuous value or class probabilities; squared error is typical for regression, while cross-entropy is typical for classification. section 11.2

Figure 11.1 A simplified feedforward neural network containing an input layer, two hidden layers, and an output layer. Information moves forward through weighted connections to produce a prediction. During training, error information moves backward so that the weights and biases can be adjusted. Modern deep networks typically contain many hidden layers and many nodes within each layer, producing millions or even billions of adjustable parameters. Despite that scale, they follow the same basic forward-and-backward process shown here.

A feedforward diagram shows predictions moving forward and error information moving backward to adjust parameters. section 11.2

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Traces prediction, loss, backpropagated gradients, parameter updates, and inference, without detailing specific optimization algorithms.
Examples
Uses pixels, sensor readings, customer features, and word embeddings, alongside regression and classification outputs and losses.
What you can do after
Understand how a single loss connects network predictions to representation learning and parameter updates.
How it connects
Connects neural networks, internal representations, loss functions, backpropagation, and optimization.

Also explained in

Compare how 4 books explain end-to-end learning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.