liveBook · Manning

Independent and identically distributed

As explained in Timeless Algorithms, The Foundational Ideas

Independent and identically distributed describes random variables that are mutually independent and share the same probability distribution.

Repeated trials are i.i.d. when each is performed under the same conditions, has the same probability of success, and does not influence the others. This makes the probability of a particular ordered sequence the product of its individual outcome probabilities. section 2.3.5

P(10 consecutive heads)=(0.5)10=0.0009765625

For ten independent fair-coin flips, the probability of the specific sequence of ten heads is 0.5 raised to the tenth power. section 2.3.5

For a fixed number of trials with two outcomes and constant success probability, i.i.d. trials also support the binomial model. It combines the probability of one sequence with the number of sequences having the same success count. section 2.3.6

How Timeless Algorithms, The Foundational Ideas covers it

How deep it goes
Defines the trial conditions, works sequence probabilities, and connects them to binomial probabilities for success counts.
Examples
Uses fair-coin sequences and illustrates binomial distributions with increasing trial counts and examples such as purchases and positive tests.
What you can do after
Apply the multiplication rule to calculate the probability of a specific sequence of independent trials.
How it connects
Connects the multiplication rule and combinatorics to binomial probability, likelihood, and the law of large numbers.

Also explained in

Compare how 5 books explain independent and identically distributed →

This explainer was generated by Manning's knowledge graph from the text of Timeless Algorithms, The Foundational Ideas. The section links point to the parts of the book it draws on.