liveBook · Manning

Missing value

As explained in Delivering Machine Learning Projects: From design to deployment

A null value is a database value representing the absence of a recorded value rather than a measured numeric value.

A missing value records the absence of a measured value. Treat null readings as a data-quality investigation, not as evidence that the underlying measurement was zero. section 5.2.2

Triage missing values with explicit checks:

  • Count null readings and compare them with the total record count. section 5.2.2
  • Count zero readings separately because zeros may be genuine measurements or substituted bad readings. section 5.2.2
  • Add unexplained patterns to the project backlog; concentrated nulls may indicate sensor failure or operating conditions. section 5.2.2

Temperature-reading survey

A table contains 262,944,000 records, including 360,959 null temperature readings—about 0.13%—and 1,890,030 zero readings. The counts suggest limited overall noise, but concentration by temperature or operating condition still requires investigation. section 5.2.2

select count(*) from temperature_readings
>262944000

Start with a total-row count, then compare it with the non-null temperature count and the zero-value count. section 5.2.2

How Delivering Machine Learning Projects: From design to deployment covers it

How deep it goes
Explains counting nulls and zeros, assessing prevalence, and investigating patterns, but stops short of prescribing imputation.
Examples
Uses temperature readings, SQL-style counts, null prevalence, and ambiguous zero measurements.
What you can do after
Diagnose missing-data prevalence and route unexplained patterns into a project backlog.
How it connects
Connects missing values with data quality, sensor failure, database querying, and modeling risk.

Also explained in

Compare how 35 books explain missing value →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Delivering Machine Learning Projects: From design to deployment. The section links point to the parts of the book it draws on.