Repartition topic
A repartition topic is an intermediate Kafka topic that redistributes records by key before downstream keyed stream processing.
Apache Kafka in Action
A repartition topic is an internal Kafka topic created to temporarily redistribute records by key before downstream keyed processing.
- How it is used
- Ensures joins and aggregations process records according to their current keys after key-changing operations.
- How deep it goes
- Explains the topic’s data flow, subtopology split, and resource costs without detailing configuration properties.
- Examples
- Uses selectKey() followed by count() and groupBy() with a new key to demonstrate when repartitioning occurs.
- What you can do after
- Evaluate how key changes affect Kafka Streams topology structure, processing correctness, network traffic, and storage.
Read how Apache Kafka in Action explains repartition topic →
Kafka Streams in Action, Second Edition
A repartition topic is an intermediate Kafka topic that temporarily receives records so they can be redistributed according to their updated keys.
- How it is used
- Routes records by updated keys before aggregations and joins in Kafka Streams topologies.
- How deep it goes
- Explains automatic and manual repartitioning, topology nodes, optimization, latency, naming, and partition-count trade-offs.
- Examples
- Uses selectKey, groupByKey, aggregation, joins, topology diagrams, and an explicit ten-partition Repartitioned configuration.
- What you can do after
- Operate/configure Kafka Streams repartitioning and avoid redundant topics when building key-dependent processing topologies.
Read how Kafka Streams in Action, Second Edition explains repartition topic →
Related concepts
- repartitionproduced by · Repartitioning is the redistribution of records or items across partitions according to a partitioning rule, potentially changing the number of partitions.
- foreign key associationused by · A foreign key association is a relationship or join between records whose key in one entity or table references a key in another.
- topickind of · A topic is a named messaging destination or stream to which producers publish messages or records and from which consumers receive or read them.
- Kafka Streamspart of · Kafka Streams is a client library for building applications that continuously process data from and write data to Apache Kafka topics.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.