liveBook · Manning

Missing value

As explained in Graph Algorithms for Data Science

Missing data is information that should be present for an entity or observation but is absent from the dataset.

A missing value is information that should exist for an entity or observation but is absent. In graph analysis, missing properties can describe incomplete records or undefined relationships between nodes. section 10.4.1 section 4.2

Analyze missing values by:

  • Counting all records with count(*) and comparing them with non-null property values returned by count(property). section 4.2
  • Reporting missingness as a percentage, casting an integer to float before division in Neo4j. section 4.2
  • Choosing a replacement that reflects the meaning of the missing value rather than applying one universal default. section 10.4.1

User registration dates

Among 3,594 User nodes, 3,518 have a non-null registeredAt property, leaving 76 missing registration dates; 97.88% are populated. The createdAt property for Tweet nodes has no missing values. section 4.2

Listing 10.10 Filling in the missing values
data['networkDistance'].fillna(4, inplace=True)
data['adamicAdar'].fillna(8.097444, inplace=True)

Fill undefined network distances with 4 and missing Adamic-Adar values with 8.097444 in a pandas DataFrame. section 10.4.1

How Graph Algorithms for Data Science covers it

How deep it goes
Defines absence, measures non-null coverage, explains graph causes, and demonstrates imputation; stops short of general missing-data theory.
Examples
Uses User registration dates, Tweet creation dates, network distances, and Adamic-Adar scores.
What it assumes
Assumes basic graph nodes and properties while teaching non-null counting and percentage calculation.
What you can do after
Apply via Neo4j Cypher and pandas to count, report, and fill missing property values.
How it connects
Ties missing values to link prediction, network distance, Adamic-Adar, and graph components.

Also explained in

Compare how 35 books explain missing value →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Graph Algorithms for Data Science. The section links point to the parts of the book it draws on.