liveBook · Manning

Kafka broker

A Kafka broker is a server process in an Apache Kafka cluster that stores records and handles producer, consumer, and other client requests.

How 3 Manning books explain it

Apache Kafka in Action

A Kafka broker is a server process that stores and serves Kafka records and participates in cluster operations.

How it is used
Serves as the cluster server that receives, stores, and makes partition records available to producers and consumers.
How deep it goes
Traces produce requests through network threads, queues, I/O threads, page cache, replication, and acknowledgments; treats complex production tuning as case-dependent.
Examples
Uses bank transfers and a three-broker topic inspection to illustrate record flow, replica placement, and replication-factor limits.
What you can do after
Operate/configure it: inspect partition leaders and replicas, choose a feasible replication factor, and provide resilient bootstrap addresses.

Read how Apache Kafka in Action explains Kafka broker →

Kafka Streams in Action, Second Edition

A Kafka broker is a server process that stores Kafka records and handles requests from Kafka clients and consumers.

How it is used
Provides Kafka’s durable storage layer and serves requests for writing, reading, and obtaining cluster metadata.
How deep it goes
Explains storage, retention, replication, topics, partitions, request handling, and health checks, while deferring some client details.
Examples
Uses produce and fetch requests, partitioned topics, replicated broker clusters, Docker-based brokers, and JMX health metrics.
What you can do after
Operate a broker through Docker, send and consume records, and diagnose request queues or timeout-related performance issues.

Read how Kafka Streams in Action, Second Edition explains Kafka broker →

Kafka for Architects

A Kafka broker is a Kafka server that stores, receives, and serves records for producers and consumers without interpreting their application-level content.

How it is used
Handles producer and consumer traffic, record storage, replication, and stream-position storage within event-driven architectures.
How deep it goes
Explains cluster roles, opaque records, consumer polling, offsets, and broker limitations, but defers detailed schema and compatibility design.
Examples
Uses a broker cluster diagram, Schema Registry message flow, and consumer polling, processing, batching, and offset-commit workflow.
What you can do after
Operate/configure broker-based flows while placing deserialization, validation, routing, and processing in clients or intermediary services.

Read how Kafka for Architects explains Kafka broker →

Also covered in

What to know first

Related concepts

Questions about Kafka broker

What is Kafka broker?

A Kafka broker is a server process in an Apache Kafka cluster that stores records and handles producer, consumer, and other client requests.

Which Manning books explain Kafka broker?

Apache Kafka in Action, Kafka Streams in Action, Second Edition and Kafka for Architects.

What should I know before learning Kafka broker?

Manning books that teach Kafka broker usually introduce client, distributed system, availability and offset first.

What kinds of Kafka broker are there?

Kinds of Kafka broker include transaction coordinator and primary node.

What is Kafka broker a kind of?

Kafka broker is a kind of server. A server is a computer system or software process that provides data, resources, or services to other systems, typically by responding to requests.

What is Kafka broker part of?

Kafka broker is part of Kafka cluster. A Kafka cluster is a group of Kafka brokers that collectively store, distribute, and serve event streams.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.