liveBook · Manning

Schema

As explained in Delivering Machine Learning Projects: From design to deployment

A schema is a formal specification of the structure, fields, types, and relationships of data.

A schema is a formal description of a data asset’s structure: its fields, types, and relationships. Inspecting the source schema reveals how a sample was formed, where data problems may exist, and what ETL work delivery will require. section 2.4

Treat schema inspection as a pre-project delivery checkpoint:

  • Identify every source table or data asset contributing to the sample. section 2.4
  • Record whether the sample is a flat table joined from underlying databases or reflects the source structure. section 2.4
  • Check update speed, arrival volume, migrations, quality campaigns, ownership, and undocumented manual preparation steps. section 2.4
  • Convert schema findings into ETL, access, security, privacy, and resourcing tickets. section 2.4

Joined sample table

A large flat sample may conceal joins across several underlying databases. Comparing its fields and relationships with the source schema can expose missing context and integration work before delivery begins. section 2.4

How Delivering Machine Learning Projects: From design to deployment covers it

How deep it goes
Explains schema as an investigation checkpoint and stops short of specifying field-level notation or implementation syntax.
Examples
Uses large flat sample tables joined from underlying databases as the concrete schema example.
What it assumes
Assumes familiarity with data assets and tables while directing attention to source structure, preparation, ownership, and system context.
What you can do after
Evaluate source structure and turn schema findings into ETL, access, security, privacy, and resourcing actions.
How it connects
Connects schema with data assets, tables, sampling, ETL, data quality, data migration, ownership, security, and privacy.

Also explained in

Compare how 44 books explain schema →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Delivering Machine Learning Projects: From design to deployment. The section links point to the parts of the book it draws on.