Stochastic gradient descent trains a network through repeated parameter updates. For each mini-batch, the network computes predictions and loss, propagates gradients backward, and adjusts its parameters. The learning rate sets the adjustment size: too large can overshoot better values, while too small can slow training. section 11.2.5
The update subtracts the loss gradient, scaled by the learning rate, from the current parameter value. section 11.2.5
An epoch is one complete pass through the data and contains multiple mini-batch updates. Repeating updates across epochs gradually reduces loss and improves predictions; mini-batch updates also reduce the computational burden of each step and add variation to the search. section 11.2.5
















