ZooKeeper
Apache ZooKeeper is a distributed coordination service that provides shared configuration, naming, synchronization, metadata management, and leader-election primitives.
Apache Kafka in Action
A ZooKeeper ensemble is a group of ZooKeeper nodes that collectively provide distributed coordination and metadata services.
- How it is used
- Coordinates older Kafka clusters by supporting controller election and storing partition assignments, leaders, and other cluster metadata.
- How deep it goes
- Explains ZNodes, competing controller writes, failure detection, and majority-based ZAB consensus without detailing the protocol’s internals.
- Examples
- Uses brokers competing to write a controller ZNode and a diagram of a Kafka cluster with a three-node ZooKeeper ensemble.
- What you can do after
- Operate/configure it by securing broker connections and planning migration of an existing Kafka cluster to KRaft.
Kafka for Architects
Apache ZooKeeper is a distributed coordination service historically used by Kafka to manage cluster metadata and controller coordination.
- How it is used
- Coordinates Kafka metadata, broker liveness, and controller operations in older Kafka deployments.
- How deep it goes
- Explains the two-cluster architecture, ZAB replication, heartbeats, controller coordination, and migration away from ZooKeeper.
- Examples
- Uses topic creation, partition assignment, broker heartbeats, controller updates, and a Kafka-ZooKeeper communication diagram.
- What you can do after
- Evaluate ZooKeeper-based Kafka architecture and assess its removal and ecosystem compatibility during upgrades.
Quarkus in Action
Apache ZooKeeper is a distributed coordination service that provides shared configuration, naming, synchronization, and metadata-management primitives.
- How it is used
- Supports Kafka metadata management in a containerized production deployment.
- How deep it goes
- Identifies ZooKeeper’s deployment role and container placement but does not explain its coordination internals or configuration.
- Examples
- Uses a separate zookeeper container in a Docker Compose topology containing Kafka and supporting infrastructure services.
- What you can do after
- Operate a local production-style Kafka infrastructure deployment that includes ZooKeeper as a supporting container.
Related concepts
- Apache Kafkaused by · Apache Kafka is a distributed event-streaming platform for publishing, storing, processing, and consuming streams of records.
- KRaftalternative to · KRaft is Apache Kafka’s Raft-based metadata-management mode, using an internal controller quorum instead of ZooKeeper.
- Zabused by · ZooKeeper Atomic Broadcast is a distributed coordination protocol that orders and replicates state changes consistently among ZooKeeper servers.
- Strimziused by · Strimzi is an open-source Kubernetes operator and set of resources for deploying and managing Apache Kafka clusters and related components.
- leader electionuses · Leader election is a distributed coordination process that selects one eligible participant to act as leader or coordinator.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.