When an experiment has more than two possible outcomes, each outcome has its own unknown probability. The Dirichlet distribution represents beliefs about that whole collection of probabilities, extending the beta distribution beyond two outcomes. section 3.9
It is a conjugate prior for the multinomial likelihood. Its hyperparameters record prior information for each outcome, and observed counts update those values directly. section 3.9
Updating a three-outcome prior
Start with Dir(1, 2, 1) for three possible outcomes. After observing n₁, n₂, and n₃ instances, the posterior becomes Dir(n₁ + 1, n₂ + 2, n₃ + 1). Each prior hyperparameter increases by the count for its corresponding outcome. section 3.9


