liveBook · Manning

Overfitting

As explained in Local Image Generation

Overfitting is a learning failure in which a model memorizes training examples or patterns too specifically and generalizes poorly to new inputs.

During LoRA training, overfitting means the model learns the training images too specifically instead of producing reliable results beyond them. Sample prompts expose this: compare familiar training-like scenes with new environments, then inspect which checkpoint behaves best. section 13.3

Use this practical check before letting a training job run for hours:

  • Select the correct dataset; a wrong dataset can waste a multi-hour training job. section 13.3
  • Add a default caption containing the trigger word as a fallback, and leave Caption Dropout Rate at 0.0; its benefit against overfitting is not established. section 13.3
  • Run sample prompts periodically, matching Sample Every to Save Every, and use the results to compare checkpoints. section 13.3

Prompts that reveal memorization

Start with familiar scenes such as “Keats the dog sitting in a fancy chair looking at the viewer” and “A photo of Keats the dog standing on a lakeside beach looking into the distance.” Add prompts placing the subject in novel environments to test generalization. section 13.3

Figure 13.14 Sample prompts are very helpful when debugging a training job.

Inspect the sample-prompt setup used to debug a training job and judge whether the model has overfit its data. section 13.3

How Local Image Generation covers it

How deep it goes
Explains practical detection through prompt selection and checkpoint comparison, without detailing model internals.
Examples
Uses familiar Keats-the-dog scenes and novel-environment prompts to expose memorization.
What it assumes
Assumes a LoRA training job, a prepared dataset, captions, a trigger word, and saved checkpoints.
What you can do after
Diagnose/debug with sample prompts and select the checkpoint that generalizes best.
How it connects
Connects overfitting with LoRA training, datasets, captions, sample prompts, and save checkpoints.

Also explained in

Compare how 33 books explain overfitting →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Local Image Generation. The section links point to the parts of the book it draws on.