A stick-breaking process constructs mixture weights without choosing the number of components in advance. Imagine a unit-length stick: break off a fraction for the first component, then repeatedly break a fraction from the remainder. The broken-off lengths become weights that sum to 1, potentially producing infinitely many components while allowing only a few to matter. section 8.9 section 8.12
The construction proceeds through successive ratios:
- Start with a stick of length 1 and choose ratios β₁, β₂, β₃, … between 0 and 1. section 8.9
- Break off β₁ of the current stick as the first component weight; retain 1 − β₁ for the next step. section 8.9
- Repeat on the remainder, breaking off β₂, then β₃, and so on. Later weights inherit the product of the preceding remainders. section 8.9
- Use the concentration parameter α to control cluster richness: small α favors fewer, larger clusters, while large α spreads weight across more small clusters. section 8.12
Three manual breaks
With β₁ = 1/3, β₂ = 1/2, and β₃ = 1/4, first break one third of the unit stick, then half of the remaining stick, then one quarter of what remains. Each broken-off portion is a mixture weight. section 8.9
Computers cannot store infinitely many components, so practical models truncate the process at a chosen upper bound. The bound should comfortably exceed the expected number of non-negligible components. In the Old Faithful mixture model, K = 10 is used with α = 1; posterior weights show that only two components matter. section 8.10
