1 Getting into data streaming

In the last decades, software has eaten the world. Across all industries, companies have adopted software solutions at their core to unlock new business models, improve their efficiency, and provide more value to customers. Businesses use CRM tools to manage customer relationships, drive their decision-making with reporting and dashboards, and predict the impact of price changes with AI models. Similar to cars requiring fuel to drive, these software systems run on data. Modern businesses employ a plethora of different software solutions that they cannot operate as isolated silos but need to integrate with each other to derive the maximum value. Integrating software systems has never been an easy task but is becoming even more complex these days.

1.1 Introducing streaming data pipelines

1.1.1 Going one step back: Batch data pipelines

1.1.2 Building blocks of streaming data pipelines

1.1.3 Integrating data in real-time with Apache Kafka

1.1.4 Benefits and challenges of streaming data pipelines

1.2 Is batch just a subset of streaming?

1.2.1 The stream-table duality

1.2.2 Batching streams of data

1.2.3 Streaming batches of data

1.2.4 Practical examples that favor streaming over batch

1.2.5 Practical examples that favor batch over streaming

1.3 What you will learn in this book

1.4 Summary