Part 3 Governance

 

Part 3 is all about governance. We’ll cover this from a few different angles.

  • Chapter 8 covers metadata (data about our data) and how this helps make sense of our data assets. In a big data platform, the ability to find and understand datasets becomes a necessity. In this chapter, we’ll use Azure Purview as our metadata store.
  • Chapter 9 talks about data quality. As data moves in and out of our platform and as we run various workloads, we need to keep an eye out for data quality issues. This chapter covers various types of data tests and data testing patterns.
  • Chapter 10 looks at another important aspect of handling data: compliance. We’ll talk about data classification and handling, access models, and supporting GDPR (General Data Protection Regulation) requirements. Compliance is a key aspect of governance.
  • Chapter 11 discusses data distribution and various patterns of sharing data with other teams. We’ll look at how we can share data through an API and how we can share it for bulk copy using Azure Data Share.