liveBook · Manning

Changelog

A changelog topic is a Kafka topic that records state-store updates so processing state can be recovered or restored.

How 2 Manning books explain it

Kafka Streams in Action, Second Edition

A changelog is an append-oriented record sequence that retains the latest record for each key.

How it is used
Supports durable state and update-stream modeling for Kafka Streams stateful processing.
How deep it goes
Explains latest-per-key semantics, compaction, restoration, caching, naming, and per-topic configuration.
Examples
Uses keyed customer purchases and a grouped count with a named materialized state store.
What you can do after
Operate/configure changelog-backed state stores by naming stores, tuning cleanup, and retaining logging.

Read how Kafka Streams in Action, Second Edition explains changelog →

Apache Kafka in Action

A changelog topic is an internal Kafka topic that durably records updates to processing state so the state can be restored after a failure.

How it is used
Preserves local table and aggregation state so Kafka Streams can restore it after an instance fails.
How deep it goes
Explains update writes and restoration by reading the topic, but does not specify changelog record formats or restoration commands.
Examples
Illustrates a per-key count state store and its compacted changelog, then describes takeover by another instance.
What you can do after
Diagnose/debug with it by identifying why a replacement task rebuilds state, or configure standby replicas to avoid that rebuild.

Read how Apache Kafka in Action explains changelog →

Also covered in

What to know first

Related concepts

Questions about changelog

What is changelog?

A changelog topic is a Kafka topic that records state-store updates so processing state can be recovered or restored.

Which Manning books explain changelog?

Kafka Streams in Action, Second Edition and Apache Kafka in Action.

What should I know before learning changelog?

Manning books that teach changelog usually introduce consumer group rebalancing, log compaction, data stream and database table first.

What is the difference between changelog and log?

A changelog topic is a Kafka topic that records state-store updates so processing state can be recovered or restored. A log is a time-ordered record of events, messages, or activity generated by a system or process.

What is changelog a kind of?

Changelog is a kind of compacted topic. A compacted topic is a Kafka topic whose log compaction retains the latest record for each key while allowing obsolete records to be removed.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.