Kafka broker
A Kafka broker is a server process in an Apache Kafka cluster that stores records and handles producer, consumer, and other client requests.
Apache Kafka in Action
A Kafka broker is a server process that stores and serves Kafka records and participates in cluster operations.
- How it is used
- Serves as the cluster server that receives, stores, and makes partition records available to producers and consumers.
- How deep it goes
- Traces produce requests through network threads, queues, I/O threads, page cache, replication, and acknowledgments; treats complex production tuning as case-dependent.
- Examples
- Uses bank transfers and a three-broker topic inspection to illustrate record flow, replica placement, and replication-factor limits.
- What you can do after
- Operate/configure it: inspect partition leaders and replicas, choose a feasible replication factor, and provide resilient bootstrap addresses.
Kafka Streams in Action, Second Edition
A Kafka broker is a server process that stores Kafka records and handles requests from Kafka clients and consumers.
- How it is used
- Provides Kafka’s durable storage layer and serves requests for writing, reading, and obtaining cluster metadata.
- How deep it goes
- Explains storage, retention, replication, topics, partitions, request handling, and health checks, while deferring some client details.
- Examples
- Uses produce and fetch requests, partitioned topics, replicated broker clusters, Docker-based brokers, and JMX health metrics.
- What you can do after
- Operate a broker through Docker, send and consume records, and diagnose request queues or timeout-related performance issues.
Read how Kafka Streams in Action, Second Edition explains Kafka broker →
Kafka for Architects
A Kafka broker is a Kafka server that stores, receives, and serves records for producers and consumers without interpreting their application-level content.
- How it is used
- Handles producer and consumer traffic, record storage, replication, and stream-position storage within event-driven architectures.
- How deep it goes
- Explains cluster roles, opaque records, consumer polling, offsets, and broker limitations, but defers detailed schema and compatibility design.
- Examples
- Uses a broker cluster diagram, Schema Registry message flow, and consumer polling, processing, batching, and offset-commit workflow.
- What you can do after
- Operate/configure broker-based flows while placing deserialization, validation, routing, and processing in clients or intermediary services.
Also covered in
What to know first
- clientA client is a person, organization, device, or software component that receives or uses a product, service, resource, or functionality provided by another party or system.
- distributed systemA distributed system is a computing system whose components run across multiple networked processes or machines and coordinate through communication.
- availabilityAvailability is the degree or proportion of time that a system or service is operational and accessible when required.
- offsetAn offset is a position or displacement measured relative to a reference point, such as within an ordered sequence, memory region, or layout.
Related concepts
- binary searchuses · Binary search is an algorithm that repeatedly halves an ordered search interval to locate a target or determine its position or boundary.
- transaction coordinatorincludes · A transaction coordinator is a component that coordinates distributed transaction participants and directs them to commit or roll back as a unit.
- serverkind of · A server is a computer system or software process that provides data, resources, or services to other systems, typically by responding to requests.
- clientused by · A client is a person, organization, device, or software component that receives or uses a product, service, resource, or functionality provided by another party or system.
- Kafka clusterpart of · A Kafka cluster is a group of Kafka brokers that collectively store, distribute, and serve event streams.
- primary nodeincludes · A primary node is a designated authoritative or coordinating member of a distributed system, typically responsible for accepting operations or coordinating replicated state.
Questions about Kafka broker
What is Kafka broker?
A Kafka broker is a server process in an Apache Kafka cluster that stores records and handles producer, consumer, and other client requests.
Which Manning books explain Kafka broker?
Apache Kafka in Action, Kafka Streams in Action, Second Edition and Kafka for Architects.
What should I know before learning Kafka broker?
Manning books that teach Kafka broker usually introduce client, distributed system, availability and offset first.
What kinds of Kafka broker are there?
Kinds of Kafka broker include transaction coordinator and primary node.
What is Kafka broker a kind of?
Kafka broker is a kind of server. A server is a computer system or software process that provides data, resources, or services to other systems, typically by responding to requests.
What is Kafka broker part of?
Kafka broker is part of Kafka cluster. A Kafka cluster is a group of Kafka brokers that collectively store, distribute, and serve event streams.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


