chapter five

5 Reliability

 

This chapter covers

  • Impact of Kafka's acks settings on message durability and producer performance
  • Role of in-sync replicas (ISRs) in ensuring data availability and fault tolerance in Kafka
  • Kafka's delivery guarantees: at-most-once, at-least-once, and exactly-once semantics
  • Kafka's transactional capabilities for atomic writes across multiple partitions
  • Kafka's use of leader-follower replication for data integrity and availability

Now we know how topics and messages look in Kafka and how Kafka relates to a log. In the next sections, we will explore some crucial aspects of Kafka's operation. Before we take a closer look at how we can influence the performance of our Kafka cluster in the next chapter, we'll examine the parameters we can adjust to improve reliability in this chapter.

5.1 Acknowledgements

5.1.1 Acknowledgement Strategies in Kafka

5.1.2 Acknowledgements and ISR

5.1.3 Message delivery guarantees in Kafka

5.2 Transactions

5.2.1 Transactions in databases

5.2.2 Transactions in Kafka

5.2.3 Transactions and consumers

5.3 Replication and the leader-follower principle

5.4 Summary