liveBook · Manning

Metadata

As explained in Effective Data Analysis

Metadata is data that describes the properties, context, provenance, or structure of other data.

Metadata is information about data: its sources, structure, formatting, properties, and relationships. In a data warehouse, it describes schemas, tables, columns, data types, row counts, and key references. section 11.3.3 section 11.5

Metadata helps analysts and stakeholders discover available resources and understand how to use them. Combined with plain-language descriptions, it supports searchable documentation and self-service analytics through a data catalog. section 11.3.3

Useful metadata commonly records:

Book metadata for competitive analysis

A scraped book site can provide titles, prices, ratings, publication years, and edition counts. Parsing these fields into a typed dataframe creates metadata that can support analysis of competitor pricing and promotions; repeated scraping can help keep the information current. section 10.2.4

Figure 11.17 Information schemas contain metadata about the information in a data warehouse.
figure

Use the information-schema view to inspect how warehouse metadata describes available data. section 11.3.3

How Effective Data Analysis covers it

How deep it goes
Defines metadata and lists warehouse properties, then connects them to documentation and data catalogs.
Examples
Uses warehouse information schemas and scraped book prices, ratings, publication years, and edition counts.
What it assumes
Assumes familiarity with data resources while defining warehouse metadata and stakeholder documentation from basic concepts.
What you can do after
Apply it via information schemas and data catalogs to discover data and support self-service analysis.
How it connects
Connects metadata with data warehouses, information schemas, documentation, data catalogs, data quality, and self-service analytics.

Also explained in

Compare how 21 books explain metadata →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Data Analysis. The section links point to the parts of the book it draws on.