liveBook · Manning

Data-generating process

As explained in Causal Inference for Data Science

A data-generation process is the physical mechanism or process responsible for creating observed data and its underlying probability distribution.

A data-generating process is the physical mechanism that creates observed data, together with the uncertainty represented by its data-generating distribution. Its laws usually remain unknown, so observed samples provide only an empirical approximation. section 1.5.1

Coin tosses and empirical evidence

A coin-toss process may have an unknown probability p of heads. Five tosses yielding H, H, T, T, T produce an empirical distribution assigning probabilities 2/5 and 3/5; larger samples tend toward the generating distribution. section 1.5.1

Use the distinction between generating and empirical distributions to:

  • Identify variables involved in the data-generation process before drawing a causal graph, consulting domain experts to reduce omitted-confounder risk. section 3.2
  • Apply the adjustment formula to the empirical distribution in practice, giving each observed row weight 1/n as a finite-sample approximation. section 4.2.1
Table 1.1 Empirical distribution from a sample of H, H, T, T, T
Outcome
Probability
H
2/5
T
3/5

Compare observed frequencies with the empirical probabilities produced by five coin tosses. section 1.5.1

How Causal Inference for Data Science covers it

How deep it goes
Defines the mechanism, contrasts generating and empirical distributions, and connects finite-sample weights to asymptotic convergence.
Examples
Uses coin tosses, a five-outcome frequency table, and datasets whose rows receive equal empirical weight.
What you can do after
Evaluate/understand which distribution represents the underlying system and approximate it with observed data when applying causal formulas.
How it connects
Connects empirical distributions with probability distributions, causal graphs, confounding, and the adjustment formula.

Also explained in

Compare how 2 books explain data-generating process →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Causal Inference for Data Science. The section links point to the parts of the book it draws on.