This chapter covers
- Understanding data platform technical metadata vs. business metadata
- Leveraging metadata to simplify data platform management
- Architecting the optimal metadata layer
- Designing a metadata model with multiple domains
- Understanding metadata layer implementation options
- Evaluating commercial and open source metadata options
In this chapter, we’ll help you get a clear understanding of what we mean by data platform internal metadata and why it is important to the operation of a data platform.
We’ll cover the difference between configuration and activity metadata and how each can be used, using examples of a data platform with growing complexity. We will show why the metadata layer should become the primary interface for data engineers and advanced data users.