liveBook · Manning

Joint probability distribution

Also called joint distribution

A joint probability distribution assigns probabilities or probability densities to combinations of values of two or more random variables.

How 6 Manning books explain it

Fabulous Adventures in Data Structures and Algorithms

A joint probability distribution assigns probabilities to combinations of outcomes from multiple random variables.

How it is used
Combines priors and likelihood functions into paired outcomes used for Bayesian updates and projections.
How deep it goes
Works through sampled pairs, exact categorical weights, integer scaling, and filtering; treats discrete distributions rather than continuous ones.
Examples
Uses a cold-and-sneezing survey, paired d20 rolls, and a rare-condition test.
What you can do after
Build it from scratch with `ToJoint`, then filter or project paired outcomes to obtain posteriors or derived distributions.

Read how Fabulous Adventures in Data Structures and Algorithms explains joint probability distribution →

Build a Reasoning Model (From Scratch)

The probability of an entire token sequence under a model, computed by multiplying conditional token probabilities across positions.

How it is used
Scores proposed answers during inference by aggregating token probabilities into a sequence-level confidence signal.
How deep it goes
Defines conditional next-token probabilities and demonstrates their multiplication in code, while deferring later log-probability scoring.
Examples
Compares Berlin and Bridge as candidate completions using per-token probabilities and computed joint scores.
What you can do after
Apply it via PyTorch to extract per-token probabilities and multiply them into a sequence score.

Read how Build a Reasoning Model (From Scratch) explains joint probability distribution →

Math and Architectures of Deep Learning

The probability that a particular combination of values for two or more random variables occurs together.

How it is used
Connects combinations of random-variable values to marginalization, independence checks, and Bayes' theorem in machine learning.
How deep it goes
Develops cells, normalization, independent products, marginal sums, and dependent-variable contrasts through worked discrete tables.
Examples
Uses quantized weight, home-distance, and height categories with numeric population tables.
What you can do after
Evaluate joint tables, recover marginals, and test independence by comparing joint probabilities with marginal products.

Read how Math and Architectures of Deep Learning explains joint probability distribution →

Outlier Detection in Python

A joint distribution describes the combined distribution of two or more variables and their dependence across values.

How it is used
Uses combined feature behavior to assess synthetic-data realism, data sparsity, and multivariate outlier likelihood.
How deep it goes
Explains marginal products, dependence preservation, and empirical-copula tail estimation, without deriving copula mathematics.
Examples
Uses categorical combinations, baseball At_bats and RBIs, left-to-right generation, and COPOD tail scoring.
What you can do after
Evaluate whether generated or observed records preserve feature associations rather than only matching individual feature distributions.

Read how Outlier Detection in Python explains joint probability distribution →

Causal AI

A full joint distribution is the joint probability distribution over both observed and latent variables in a model.

How it is used
Frames observed outcomes and causal mechanisms as distinct objects in probabilistic generative modeling.
How deep it goes
Explains outcome mapping, empirical estimation, latent-variable marginalization, and sampling, but stops short of a complete causal identification procedure.
Examples
Uses a five-observation rock-throw dataset, eight binary outcome combinations, latent impact strength, and pgmpy sampling code.
What you can do after
Evaluate/understand the gap between empirical observations, joint distributions, latent-variable models, and generative sampling.

Read how Causal AI explains joint probability distribution →

Retrieval Augmented Generation, The Foundational Ideas

Joint probability is the probability that multiple events or variables take specified values together.

How it is used
Uses joint probability to train retrieval and answer prediction as one REALM objective.
How deep it goes
Explains definition, log-space computation, marginalization, tensor shapes, and a small numerical example.
Examples
Demonstrates three candidate documents, NumPy log-sum-exp marginalization, and retrieval-score boosts that reduce loss.
What you can do after
Evaluate joint and marginal probabilities and implement their log-space calculation for document retrieval training.

Read how Retrieval Augmented Generation, The Foundational Ideas explains joint probability distribution →

What to know first

Related concepts

Questions about joint probability distribution

What is joint probability distribution?

A joint probability distribution assigns probabilities or probability densities to combinations of values of two or more random variables.

Which Manning books explain joint probability distribution?

Fabulous Adventures in Data Structures and Algorithms, Build a Reasoning Model (From Scratch), Math and Architectures of Deep Learning, Outlier Detection in Python, Causal AI and Retrieval Augmented Generation, The Foundational Ideas.

What should I know before learning joint probability distribution?

Manning books that teach joint probability distribution usually introduce probability distribution, probability theory, random variable and softmax first.

What is the difference between joint probability distribution and likelihood?

A joint probability distribution assigns probabilities or probability densities to combinations of values of two or more random variables. A likelihood is the probability of observed data under a model, viewed as a function of the model’s parameters or candidate hypotheses.

What is joint probability distribution also called?

Joint probability distribution is also called joint distribution.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.