liveBook · Manning

Resilience

As explained in Kafka for Architects

Fault tolerance is the ability of a system to continue providing its required behavior despite failures in components or dependencies.

Resilience is a system’s ability to continue providing required behavior when components or dependencies fail. In Kafka architectures, it protects business data from component loss through durable storage and replication. section 1.7.3 section 5.2.8

Kafka supports resilience through several architectural choices:

  • Replicates partitions across brokers so that, with the correct configuration, at least one copy remains available after a component failure. section 5.2.8
  • Persists an immutable event sequence, improving durability while supporting high-throughput distributed processing. section 1.7.3
  • Decouples event-driven microservices, improving scalability and reducing the impact of failures between services. section 5.5

Business data that cannot be lost

Financial, healthcare, and e-commerce systems can duplicate components through Kafka partition replication so that one broker failure does not cause data loss. section 5.2.8

Resilience is an architectural trade-off rather than a default guarantee. Deployment decisions must balance fault tolerance with operational complexity, scalability, multi-region design, security, compliance, and infrastructure management. section 9.2

How Kafka for Architects covers it

How deep it goes
Explains partition replication and durable storage, but leaves availability dependent on correct configuration and broader deployment choices.
Examples
Uses financial, healthcare, e-commerce, clickstream, fraud-scoring, telemetry, and operational-alerting scenarios.
What you can do after
Evaluate Kafka deployment and replication choices against data-loss tolerance, scalability, compliance, and operational constraints.
How it connects
Connects partition replication with brokers, durable logs, event-driven architecture, microservices, and deployment architecture.

Also explained in

Compare how 13 books explain resilience →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Kafka for Architects. The section links point to the parts of the book it draws on.