liveBook · Manning

Data quality

As explained in Timeless Algorithms, The Foundational Ideas

Data quality is the degree to which data are accurate, relevant, consistent, and sufficiently complete for their intended use.

Data quality is how well data serve their intended use. For machine learning, more observations do not necessarily mean better data: useful training data must be accurate, relevant, and broad enough to represent operating conditions. section 11.6.3 section 13.5.2

Assess training data along several dimensions:

  • Accuracy and consistency: incorrect labels and inconsistent measurements can weaken learned representations. section 11.6.3
  • Relevance and coverage: data should reflect the conditions and population where a model will operate; more examples from a narrow setting do not fill coverage gaps. section 11.6.3
  • Informational value: duplication, errors, and narrow distributions can add volume without adding much new information. section 13.5.2

For example, a pedestrian detector trained mostly on clear daytime images may fail at night or in severe weather. More daytime images do not remedy that gap. Validation on data from the same source as training may also miss distribution shifts, so production performance needs monitoring as conditions change. section 11.6.3 section 11.6.3

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Distinguishes accuracy, consistency, relevance, coverage, and informational value without defining a quantitative quality metric.
Examples
Uses daytime-only pedestrian images, duplicated internet documents, and errors in collected text to illustrate data limitations.
What you can do after
Evaluate training collections for inaccurate labels, inconsistent measurements, missing coverage, duplication, and deployment mismatch.
How it connects
Connects data quality to machine learning, training data, representativeness, distribution shift, and bias.

Also explained in

Compare how 15 books explain data quality →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.