An epoch is one complete pass through the training data. Because training processes data in mini-batches, an epoch contains multiple parameter updates; training usually continues across many epochs. section 11.2.5
Each mini-batch update adjusts parameters using the loss gradient; many such updates can occur within one epoch. section 11.2.5
Batch size of one
When training processes one observation per update, processing every observation once completes one epoch. section 11.3.5













