How deeply does Kafka for Architects cover state persistence?

Defines broker storage, replication, retention, and consumer recovery, without detailing storage internals.

State persistence

Message persistence is the durable storage of messages beyond the lifetime of the process that produced or consumed them.

Kafka message persistence stores messages on broker disks rather than in memory. Brokers replicate messages, helping the cluster retain them through a broker failure; consumers can resume after disconnection or replay stored messages. section 1.4.2 section 1.7.3

Retention may be configured for a set duration or indefinitely. Unlike systems that remove messages after consumer acknowledgment, Kafka removes data when its retention period expires—even if it has not been processed. Align retention with application needs and monitor disk capacity. section 5.2.5

How Kafka for Architects covers it

liveBook manning.com

Read Kafka for Architects on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

MongoDB 8.0 in Action, Third EditionPersistence is the durable storage of program state so that it survives beyond a single program execution.
liveBook manning.com

Elixir in Action, Third EditionData persistence is the retention of data beyond the lifetime of the computation that created or processed it.
liveBook manning.com

Designing Deep Learning Systems: A guide for software engineersThe retention of data across process executions and system interactions so that it remains available for later retrieval.
liveBook manning.com

Kubernetes in Action, Second EditionData persistence is the preservation of data so that it remains available across process or container termination and recreation.
liveBook manning.com

AI Agents in Action, Second EditionPersistence is the continuation of a system's goal-directed operation across multiple steps or interactions.
liveBook manning.com

Introduction to Generative AI, Second EditionPersistent state is information about an application or agent that remains available across operations or interactions.

Compare how 7 books explain state persistence →

Related concepts

state managementused by · State management is the practice of organizing, maintaining, and updating information that represents a system’s or process’s condition over time.
databasealternative to · A database is an organized collection of persistent data managed by software for storage, retrieval, querying, and modification.
Apache Kafkaused by · Apache Kafka is a distributed event-streaming platform for publishing, storing, processing, and consuming streams of records.
streamingused by · Streaming is the incremental handling of a sequence of data items, including their processing, transfer, or consumption as they become available.
E2Bused by · E2B is a cloud platform that provides isolated sandbox environments for executing code.

This explainer was generated by Manning's knowledge graph from the text of Kafka for Architects. The section links point to the parts of the book it draws on.