Flink
Apache Flink is an open-source distributed processing framework for stateful computation over bounded and unbounded data streams.
Architecting an Apache Iceberg Lakehouse
Apache Flink is an open-source distributed processing framework for stateful batch and stream computations.
- How it is used
- Handles low-latency, stateful streaming and batch ingestion into Iceberg tables.
- How deep it goes
- Explains APIs, checkpoints, event time, transformations, and operational tradeoffs without descending into engine internals.
- Examples
- Uses Kafka-to-Iceberg SQL and DataStream examples alongside fintech, media, healthcare, and logistics ingestion scenarios.
- What you can do after
- Build real-time Kafka-to-Iceberg pipelines with transformations, checkpoints, event-time handling, and controlled commits.
Read how Architecting an Apache Iceberg Lakehouse explains Flink →
Kafka for Architects
Apache Flink is an open-source distributed stream-processing framework for stateful computations over bounded and unbounded data streams.
- How it is used
- Positions Flink as a processing layer that transforms and routes events, particularly when pipelines must also reach beyond Kafka.
- How deep it goes
- Defines jobs, stream bounds, and connector roles, then outlines runtime deployment without a low-level implementation walkthrough.
- Examples
- Illustrates content-based address routing and a Customer 360 operational data store, including a depicted design without Kafka.
- What you can do after
- Evaluate/understand when Flink’s batch-and-stream capabilities and external connectors suit a pipeline better than a Kafka-centered option.
Also covered in
What to know first
- stream processingStream processing is the incremental processing of data items as they become available, without requiring the complete dataset to be present first.
- SQLSQL is a standardized declarative language for defining, querying, and manipulating data in relational database systems.
Related concepts
- Apache Kafkauses · Apache Kafka is a distributed event-streaming platform for publishing, storing, and processing streams of records.
- checkpointinguses · Checkpointing is the recording of an intermediate state or progress point in a process to support recovery, resumption, inspection, or control.
- Kafka Streamsalternative to · Kafka Streams is a client library for building applications that continuously process data from and write data to Apache Kafka topics.
- Apache Iceberguses · Apache Iceberg is an open table format for managing large analytical datasets with metadata, schema evolution, snapshots, and transactional operations across distributed or object storage.
- stream processingkind of · Stream processing is the incremental processing of data items as they become available, without requiring the complete dataset to be present first.
Questions about Flink
What is Flink?
Apache Flink is an open-source distributed processing framework for stateful computation over bounded and unbounded data streams.
Which Manning books explain Flink?
Architecting an Apache Iceberg Lakehouse and Kafka for Architects.
What should I know before learning Flink?
Manning books that teach Flink usually introduce stream processing and SQL first.
What is the difference between Flink and Kafka Streams?
Apache Flink is an open-source distributed processing framework for stateful computation over bounded and unbounded data streams. Kafka Streams is a client library for building applications that continuously process data from and write data to Apache Kafka topics.
What is Flink a kind of?
Flink is a kind of stream processing. Stream processing is the incremental processing of data items as they become available, without requiring the complete dataset to be present first.
What are the parts of Flink?
Flink includes DataStream API.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

