Changelog
A changelog topic is a Kafka topic that records state-store updates so processing state can be recovered or restored.
Kafka Streams in Action, Second Edition
A changelog is an append-oriented record sequence that retains the latest record for each key.
- How it is used
- Supports durable state and update-stream modeling for Kafka Streams stateful processing.
- How deep it goes
- Explains latest-per-key semantics, compaction, restoration, caching, naming, and per-topic configuration.
- Examples
- Uses keyed customer purchases and a grouped count with a named materialized state store.
- What you can do after
- Operate/configure changelog-backed state stores by naming stores, tuning cleanup, and retaining logging.
Read how Kafka Streams in Action, Second Edition explains changelog →
Apache Kafka in Action
A changelog topic is an internal Kafka topic that durably records updates to processing state so the state can be restored after a failure.
- How it is used
- Preserves local table and aggregation state so Kafka Streams can restore it after an instance fails.
- How deep it goes
- Explains update writes and restoration by reading the topic, but does not specify changelog record formats or restoration commands.
- Examples
- Illustrates a per-key count state store and its compacted changelog, then describes takeover by another instance.
- What you can do after
- Diagnose/debug with it by identifying why a replacement task rebuilds state, or configure standby replicas to avoid that rebuild.
Also covered in
What to know first
- consumer group rebalancingConsumer group rebalancing is the redistribution of topic-partition assignments among consumer group members after membership or partition availability changes.
- log compactionLog compaction is a storage technique that retains the latest record for each key while removing superseded records.
- data streamA data stream is an ordered sequence of data items that may be ongoing and is made available incrementally for consumption or processing.
- database tableA database table is a relational data structure that organizes records into rows whose values correspond to defined columns.
Related concepts
- compacted topickind of · A compacted topic is a Kafka topic whose log compaction retains the latest record for each key while allowing obsolete records to be removed.
- state storeused by · A state store is a storage component that maintains application or processing state and provides mechanisms to access or update it.
- logcontrasts with · A log is a time-ordered record of events, messages, or activity generated by a system or process.
- standby taskused by · A standby task is an inactive Kafka Streams task that maintains a replicated state-store copy for faster failover when an active task is reassigned.
- KTableused by · KTable is a Kafka Streams abstraction representing the latest value associated with each key as a continuously updated table.
- data lossaddresses · Data loss is the destruction, corruption, deletion, or unavailability of information that is expected to be retained or remain usable.
Questions about changelog
What is changelog?
A changelog topic is a Kafka topic that records state-store updates so processing state can be recovered or restored.
Which Manning books explain changelog?
Kafka Streams in Action, Second Edition and Apache Kafka in Action.
What should I know before learning changelog?
Manning books that teach changelog usually introduce consumer group rebalancing, log compaction, data stream and database table first.
What is the difference between changelog and log?
A changelog topic is a Kafka topic that records state-store updates so processing state can be recovered or restored. A log is a time-ordered record of events, messages, or activity generated by a system or process.
What is changelog a kind of?
Changelog is a kind of compacted topic. A compacted topic is a Kafka topic whose log compaction retains the latest record for each key while allowing obsolete records to be removed.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

