How deeply does Kafka for Architects cover TopologyTestDriver?

Explains test topics, serialization, output assertions, simulated time, and state inspection; defers real-cluster communication to integration testing.

TopologyTestDriver

As explained in Kafka for Architects

TopologyTestDriver is a Kafka Streams testing class that executes and verifies a topology without requiring a running Kafka cluster.

TopologyTestDriver tests an entire Kafka Streams topology without a running Kafka cluster or mock producers and consumers. It exercises the topology’s interconnected processing nodes as events are transformed, enriched, or stored. section 10.3.1

A topology test typically uses:

TestInputTopic and TestOutputTopic objects configured with topic names and key/value serializers and deserializers. section 10.3.1
Input records piped into simulated topics, with output records read back and verified after processing. section 10.3.1
Serialized and deserialized messages that mirror production byte-array communication, plus simulated time and inspectable intermediate state for stateful processing. section 10.3.1

Testing a stateful topology

Feed records into a TestInputTopic, allow the topology to transform or enrich them, advance simulated time when needed, and verify records emitted through a TestOutputTopic or inspect intermediate state. section 10.3.1

TopologyTestDriver validates stream-processing behavior while remaining isolated from broker connectivity. Integration tests are still needed to verify communication with a real Kafka cluster, including serialization, topic configuration, and connectivity. section 10.3.1

How Kafka for Architects covers it

liveBook manning.com

Read Kafka for Architects on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

Kafka Streams in Action, Second EditionTopologyTestDriver is a Kafka Streams test utility that runs a topology in memory and provides test input, output, and state-store access.

Compare how 2 books explain TopologyTestDriver →

Related concepts

processor topologyuses · A processor topology is a directed graph of source, processor, and sink nodes that defines how records flow through a stream-processing application.
state storeuses · A state store is a storage component that maintains application or processing state and provides mechanisms to access or update it.
Kafka Streamsused by · Kafka Streams is a client library for building applications that continuously process data from and write data to Apache Kafka topics.
TestInputTopicproduces · TestInputTopic is a Kafka Streams testing utility that represents an input topic and supplies records to a topology under test.
TestOutputTopicproduces · TestOutputTopic is a Kafka Streams testing utility that represents an output topic and reads records produced by a topology under test.

This explainer was generated by Manning's knowledge graph from the text of Kafka for Architects. The section links point to the parts of the book it draws on.