liveBook · Manning

Epoch

As explained in Software Testing with Generative AI

An epoch is one complete iteration through all entries in a training dataset during model training.

An epoch is one complete pass through every entry in a training dataset. Fine-tuning commonly repeats this pass several times so the model can progressively adjust toward the desired responses. section 12.2.2

During a fine-tuning run, the epoch value indicates how far the process has progressed through the current pass. It is therefore a progress measure, not a quality score by itself. section 12.2.4

Reading epoch progress

A training log such as {"loss": 1.0936, "learning_rate": 0.00019999, "epoch": 0.02} shows that the run is only 0.02 epochs into its dataset pass. Repeated log entries at the same displayed value can report different loss values while progress remains near the beginning. section 12.2.4

{'loss': 1.0936, 'learning_rate': 0.00019999154711147226, 'epoch': 0.02}
{'loss': 1.3172, 'learning_rate': 0.00019999135609452385, 'epoch': 0.02}
{'loss': 1.0351, 'learning_rate': 0.0001999911629434316, 'epoch': 0.02}

Inspect representative training-log entries showing epoch progress alongside loss and learning rate. section 12.2.4

How Software Testing with Generative AI covers it

How deep it goes
Defines a complete dataset pass and interprets logged progress, but does not explain batch-level scheduling or stopping criteria.
Examples
Uses console logs containing loss, learning rate, and fractional epoch values to illustrate training progress.
What it assumes
Assumes familiarity with datasets and model fine-tuning while defining epoch from the dataset-iteration level.
What you can do after
Evaluate training progress by interpreting an epoch value in relation to the dataset pass and neighboring metrics.
How it connects
Connects dataset iteration with fine-tuning, loss, learning rate, hyperparameters, and model training.

Also explained in

Compare how 10 books explain epoch →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Software Testing with Generative AI. The section links point to the parts of the book it draws on.