liveBook · Manning

Online learning

Online learning is a machine-learning approach that updates a model incrementally as individual examples, batches, or interaction outcomes become available.

How 2 Manning books explain it

Kafka for Architects

Incremental learning is a machine-learning technique that updates a model progressively as new data arrives rather than retraining only from scratch.

How it is used
Positions online learning as continuous model adaptation when fast-changing events make periodic retraining too slow.
How deep it goes
Defines parameter updates and outlines Kafka consumer batches and Flink ML capabilities, without detailing algorithm implementations.
Examples
Illustrates a Kafka consumer feeding event batches to a model, with fraud detection, personalization, and operational monitoring as applications.
What you can do after
Apply it via Flink ML to combine historical training with learning from streaming data.

Read how Kafka for Architects explains online learning →

Applied Reinforcement Learning

Online learning updates a model incrementally as data or interaction outcomes become available rather than waiting for a complete dataset or episode.

How it is used
Updates an agent’s knowledge continuously during interaction instead of waiting for a complete dataset.
How deep it goes
Contrasts continuous updates with batch training and connects online learning to TD, without specifying a general-purpose procedure.
Examples
Uses real-time business adjustments to prices, inventory, or marketing in response to live market signals.
What you can do after
Apply it by updating decisions as live market signals arrive, such as when adjusting prices, inventory, or marketing.

Read how Applied Reinforcement Learning explains online learning →

Also covered in

What to know first

Related concepts

Questions about online learning

What is online learning?

Online learning is a machine-learning approach that updates a model incrementally as individual examples, batches, or interaction outcomes become available.

Which Manning books explain online learning?

Kafka for Architects and Applied Reinforcement Learning.

What should I know before learning online learning?

Manning books that teach online learning usually introduce batching and language model first.

What is the difference between online learning and inference?

Online learning is a machine-learning approach that updates a model incrementally as individual examples, batches, or interaction outcomes become available. Inference is the process of applying a trained model to input data to produce predictions or other outputs.

What is online learning a kind of?

Online learning is a kind of language model. A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.