Online learning
Online learning is a machine-learning approach that updates a model incrementally as individual examples, batches, or interaction outcomes become available.
Kafka for Architects
Incremental learning is a machine-learning technique that updates a model progressively as new data arrives rather than retraining only from scratch.
- How it is used
- Positions online learning as continuous model adaptation when fast-changing events make periodic retraining too slow.
- How deep it goes
- Defines parameter updates and outlines Kafka consumer batches and Flink ML capabilities, without detailing algorithm implementations.
- Examples
- Illustrates a Kafka consumer feeding event batches to a model, with fraud detection, personalization, and operational monitoring as applications.
- What you can do after
- Apply it via Flink ML to combine historical training with learning from streaming data.
Applied Reinforcement Learning
Online learning updates a model incrementally as data or interaction outcomes become available rather than waiting for a complete dataset or episode.
- How it is used
- Updates an agent’s knowledge continuously during interaction instead of waiting for a complete dataset.
- How deep it goes
- Contrasts continuous updates with batch training and connects online learning to TD, without specifying a general-purpose procedure.
- Examples
- Uses real-time business adjustments to prices, inventory, or marketing in response to live market signals.
- What you can do after
- Apply it by updating decisions as live market signals arrive, such as when adjusting prices, inventory, or marketing.
Read how Applied Reinforcement Learning explains online learning →
Also covered in
- Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
- Machines that ThinkIn early access (MEAP)
- Machine Learning System Design
What to know first
- batchingBatching is the grouping of multiple items, requests, or operations so they can be processed together as a unit.
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
Related concepts
- language modelkind of · A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- out-of-core learningequivalent to · Out-of-core learning is an incremental training technique that processes data from external storage in portions without loading the entire dataset into memory.
- traininguses · Training is the process of fitting a machine-learning model to data by adjusting its parameters or learned representations to improve its performance on a task.
- Apache Kafkaused by · Apache Kafka is a distributed event-streaming platform for publishing, storing, and processing streams of records.
- clientused by · A client is a person, organization, device, or software component that receives or uses a product, service, resource, or functionality provided by another party or system.
- inferencecontrasts with · Inference is the process of applying a trained model to input data to produce predictions or other outputs.
Questions about online learning
What is online learning?
Online learning is a machine-learning approach that updates a model incrementally as individual examples, batches, or interaction outcomes become available.
Which Manning books explain online learning?
Kafka for Architects and Applied Reinforcement Learning.
What should I know before learning online learning?
Manning books that teach online learning usually introduce batching and language model first.
What is the difference between online learning and inference?
Online learning is a machine-learning approach that updates a model incrementally as individual examples, batches, or interaction outcomes become available. Inference is the process of applying a trained model to input data to produce predictions or other outputs.
What is online learning a kind of?
Online learning is a kind of language model. A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

