liveBook · Manning

Learning rate

As explained in Machine Learning Platform Engineering

A learning rate is a training hyperparameter that controls the step size used to update model parameters during optimization.

A learning rate is a training hyperparameter that controls parameter-update step size. In production training, choose it alongside batch size and model architecture to balance efficiency, resource use, accuracy, and training time. section 8.1.2

Use learning-rate tuning as part of an iterative training workflow:

  • Begin with a small, robust hyperparameter set rather than manually tuning every training option. section 8.1.7
  • If the model does not converge, alter the learning rate together with batch size or number of epochs. section 8.1.7
  • Treat each training job as an opportunity to refine parameters for the target use case and its performance requirements. section 8.1.2 section 8.1.7

ID card detection training

For an Ultralytics YOLO ID card detector, start with a production-oriented configuration and monitor training results. If the model fails to converge, revise the learning rate, batch size, or epoch count, then compare the resulting artifacts and detections. section 8.1.2 section 8.1.7

How Machine Learning Platform Engineering covers it

How deep it goes
Explains learning-rate tuning as an iterative response to convergence problems but does not detail optimization internals.
Examples
Uses an Ultralytics YOLO ID card detector and revises learning rate, batch size, or epochs when training fails to converge.
What you can do after
Diagnose non-converging training by adjusting the learning rate alongside batch size and epochs.
How it connects
Ties learning rate to hyperparameters, batch size, epochs, model training, convergence, and validation.

Also explained in

Compare how 16 books explain learning rate →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning Platform Engineering. The section links point to the parts of the book it draws on.