8 Comparing self-serve data platforms

 

This chapter covers

  • Platforms leveraging Google Cloud Platform
  • Platforms leveraging Amazon Web Services
  • Platforms leveraging Databricks
  • Platforms leveraging Apache Kafka
  • Pros and cons of each platform

In the first part of this book, you learned all the basics of the data mesh. In chapter 7, you did a deep dive into building self-serve platforms using the example of Messflix. You learned how to iterate on one specific example and build up a fully functioning platform.

This chapter is different. While the data mesh paradigm is not tied to any one implementation, we believe it’s necessary to see it in action more than once to really find a suitable architecture for your platform.

This is the focus of this chapter: supplying you with multiple architectures and technology stacks to make it easy for you to choose a good architecture. We will walk you through four possible architectures that all are inspired by real-world examples implemented at multiple companies throughout the world.

8.1 Data mesh on Google Cloud Platform

 
 

8.1.1 Self-serve data platform architecture

 
 
 
 

8.1.2 Identifying the components of the platform

 
 

8.1.3 Identifying the components of the data product

 

8.1.4 Workflows

 
 

8.1.5 Variations

 
 
 

8.1.6 Relation to data mesh ideas

 

8.1.7 GCP architecture summary

 
 
 

8.2 Data mesh on AWS

 
 
 

8.2.1 Self-serve data platform architecture

 
 
 

8.2.2 Identifying the components of the platform

 
 
 

8.2.3 Identifying the components of the data products

 
 
sitemap

Unable to load book!

The book could not be loaded.

(try again in a couple of minutes)

manning.com homepage
test yourself with a liveTest