Exactly-once delivery
Exactly-once delivery is a processing guarantee that each input produces its intended externally visible effect once, without loss or duplicate effects, despite retries or failures.
Kafka for Architects
Exactly-once delivery is a processing guarantee in which each record's effect is applied once despite retries or failures.
- How it is used
- Protects Kafka read-process-write pipelines from duplicate or missing outputs during retries and failures.
- How deep it goes
- Details atomic output, state, and offset commits and names the Kafka Streams setting, without a full client implementation walkthrough.
- Examples
- Illustrates one order generating shipment, billing, and inventory events, where duplicates or omissions cause downstream discrepancies.
- What you can do after
- Operate/configure it in Kafka Streams with processing.guarantee set to EXACTLY_ONCE_V2.
Read how Kafka for Architects explains exactly-once delivery →
Kafka Streams in Action, Second Edition
Exactly-once semantics is a message-processing guarantee that each input record's effects are applied once without duplicate results despite retries or failures.
- How it is used
- Guarantees reliable Kafka record delivery when retries, consumer failures, or transactional processing make duplicates or loss unacceptable.
- How deep it goes
- Distinguishes delivery guarantees and explains idempotent, transactional, offset, and isolation configurations without showing transaction implementation code.
- Examples
- Uses producer retries, aborted transactions, per-partition idempotence, and atomic publication across multiple topics as concrete cases.
- What you can do after
- Configure KafkaProducer transactions, assign unique transactional IDs, and consume transactional topics using read_committed isolation.
Read how Kafka Streams in Action, Second Edition explains exactly-once delivery →
Think Distributed Systems
A message-delivery guarantee in which each sent message is delivered exactly one time.
- How it is used
- Clarifies delivery guarantees and redirects reliable system design toward exactly-once processing semantics.
- How deep it goes
- Derives impossibility from sender choices and failure uncertainty, then explains equivalence, idempotence, and end-to-end requirements.
- Examples
- Uses duplicate-suppression algorithms, airline-ticket payment retries, reservation identifiers, and Stripe-style idempotency keys.
- What you can do after
- Evaluate delivery claims and design retries around idempotent processing rather than assuming literal exactly-once delivery.
Read how Think Distributed Systems explains exactly-once delivery →
Apache Kafka in Action
Exactly-once semantics guarantee that each input message produces one durable effect in the destination despite retries or failures.
- How it is used
- Prevents retries after uncertain ACKs from turning one intended write into duplicate durable messages or effects.
- How deep it goes
- Explains producer sequence IDs and works through database and Kafka transaction patterns, while leaving transaction-coordinator internals to a summary.
- Examples
- Uses a lost-ACK banking transaction, PostgreSQL write patterns, and a Python transactional producer updating two balances.
- What you can do after
- Operate/configure it with idempotent producers, and apply transactional offset handling when processing Kafka messages into Kafka or a database.
Read how Apache Kafka in Action explains exactly-once delivery →
Architecting an Apache Iceberg Lakehouse
Exactly-once semantics guarantee that each input record contributes its intended processing effect no more than once despite retries or failures.
- How it is used
- Builds reliable streaming and batch ingestion pipelines where retries, restarts, duplicates, and partial table writes must be controlled.
- How deep it goes
- Explains replayability, checkpointing, two-phase commits, atomic snapshots, state recovery, and commit-frequency tradeoffs without low-level protocol detail.
- Examples
- Demonstrates Kafka-to-Iceberg Flink SQL, checkpoint-based retries, and Spark Structured Streaming with Iceberg checkpoints.
- What you can do after
- Build it from scratch with Flink or Spark, configuring replayable sources, checkpoints, transactional sinks, and recovery-aware streaming commits.
Read how Architecting an Apache Iceberg Lakehouse explains exactly-once delivery →
Akka in Action, Second Edition
Effectively-once delivery is a processing guarantee that combines at-least-once processing with deduplication so that duplicate processing has one externally visible effect.
- How it is used
- Guarantees one externally visible effect when retries or crashes cause duplicate processing in Kafka streams and journal projections.
- How deep it goes
- Explains retry behavior, deduplication, APIs, configuration, identity constraints, and performance tradeoffs without developing transaction internals.
- Examples
- Uses an A-to-B-to-C retry pipeline, transactional Kafka source and sink, and an event-to-database projection.
- What you can do after
- Apply it via Akka Transactional or Akka projections to process Kafka or journal events with deduplicated effects.
Read how Akka in Action, Second Edition explains exactly-once delivery →
Also covered in
What to know first
- topicA topic is a named channel or category that groups messages or records for publication and delivery to interested consumers.
- partitionA division of a whole into distinct parts that together comprise the whole.
- parallelismParallelism is the execution of multiple independent tasks or computational operations at the same time rather than sequentially.
- clientA client is a person, organization, device, or software component that receives or uses a product, service, resource, or functionality provided by another party or system.
Related concepts
- idempotencycontrasts with · Idempotency is the property of an operation whereby repeating it has the same effective result or externally observable effect as performing it once.
- deduplicationaddressed by · The process of identifying and removing, suppressing, or consolidating duplicate representations of the same logical item, event, or operation according to a defined criterion.
- Kafka Streamsimplemented by · Kafka Streams is a client library for building applications that continuously process data from and write data to Apache Kafka topics.
- mathematical equivalenceuses · Mathematical equivalence is a relation in which expressions, values, or states are considered the same under a specified interpretation or criterion.
Questions about exactly-once delivery
What is exactly-once delivery?
Exactly-once delivery is a processing guarantee that each input produces its intended externally visible effect once, without loss or duplicate effects, despite retries or failures.
Which Manning books explain exactly-once delivery?
Kafka for Architects, Kafka Streams in Action, Second Edition, Think Distributed Systems, Apache Kafka in Action, Architecting an Apache Iceberg Lakehouse and Akka in Action, Second Edition.
What should I know before learning exactly-once delivery?
Manning books that teach exactly-once delivery usually introduce topic, partition, parallelism and client first.
What is the difference between exactly-once delivery and idempotency?
Exactly-once delivery is a processing guarantee that each input produces its intended externally visible effect once, without loss or duplicate effects, despite retries or failures. Idempotency is the property of an operation whereby repeating it has the same effective result or externally observable effect as performing it once.
What is exactly-once delivery a kind of?
Exactly-once delivery is a kind of delivery semantics. Delivery semantics are guarantees about whether and how often messages or records are delivered during processing.
What is exactly-once delivery also called?
Exactly-once delivery is also called exactly-once semantics, exactly-once message delivery or exactly-once processing.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.





