Processing node
A processing node is a stream-processing component in a topology that processes records using logic such as filtering, aggregation, or transformation.
Kafka Streams in Action, Second Edition
The Processor API is the lower-level Kafka Streams programming interface for processing records with direct access to record context and metadata.
- How it is used
- Builds record-processing steps in Kafka Streams topologies, using the Processor API when DSL operations cannot provide required control.
- How deep it goes
- Explains topology wiring, process() logic, selective forwarding, state stores, punctuation, and node inspection; defers deeper sub-topology treatment.
- Examples
- Uses uppercase messages, beer-sales currency routing, stock trend analysis, and sensor aggregation processors.
- What you can do after
- Build it from scratch by wiring named sources, processors, and sinks and implementing process() to transform or selectively forward records.
Read how Kafka Streams in Action, Second Edition explains processing node →
Kafka for Architects
A processing node is a topology node that contains stream-processing logic such as filtering, aggregation, or transformation.
- How it is used
- Implements filtering, mapping, joining, aggregation, or transformation within a Kafka Streams topology.
- How deep it goes
- Details graph placement, state-store links, Java Processor implementations, scheduling, and low-level Kafka access.
- Examples
- Uses fraud detection with historical state and event flow from input topics through processing nodes to output topics.
- What you can do after
- Build custom processing logic as Java Processor implementations and place it in an explicitly defined topology.
Related concepts
- mapValuesproduced by · mapValues is an operation that transforms values associated with keys while preserving those keys.
- data-driven windowinguses · Data-driven windowing is the technique of defining a stream window through record values or behavioral conditions instead of predetermined time boundaries.
- processor topologypart of · A processor topology is a directed graph of source, processor, and sink nodes that defines how records flow through a stream-processing application.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.