Probabilistic reasoning weighs competing possibilities under uncertainty. Observed data provides evidence about unknown causes, states, parameters, or structures; probabilistic models determine how those possibilities are weighed. section 10.0
For mutually exclusive events, add their probabilities. If the outcomes also cover every possibility, their probabilities sum to one. section 2.3.1
Competing outcomes
A fair die has a 1/6 chance of showing either a 2 or a 5, so the chance of either is 1/3. The two outcomes are mutually exclusive, but do not cover every possible roll. Similar probability allocations describe competing diagnoses or classifier labels. section 2.3.1
This probabilistic framework links ideas across fields: decoding can be expressed as Bayesian model comparison, message passing can perform inference, and cross-entropy can guide model training. section 10.3


