liveBook · Manning

Poisson-gamma distribution

As explained in Ensemble Methods for Machine Learning

A compound Poisson-gamma distribution combines a Poisson count of events with gamma-distributed positive event magnitudes.

A Poisson-gamma distribution models hybrid targets with many exact zeros, plus positive continuous values that are typically right-skewed. It combines a Poisson component for the zero-heavy event count with a gamma component for positive magnitudes. section 7.3.1

Use the distribution when the target shows this pattern:

  • A large point mass occurs at zero, representing days or cases with no events. section 7.3.1
  • Positive observations vary continuously and form a right-skewed tail. section 7.3.1
  • A Tweedie distribution with 1 < p < 2 provides the corresponding compound loss family. section 7.3.1

Rainfall and bike-sharing demand

Rainfall has many zero-rain days and occasional heavy rainfall, making the compound structure intuitive. UCI Bike Sharing casual-user counts show a related long-tailed pattern; their log-transformed histogram resembles the rainfall pattern and motivates Tweedie modeling. section 7.3.1 section 7.4.1

Figure 7.11 Modeling some types of labels effectively requires combinations of distributions, called compound distributions. One such compound distribution is the Tweedie distribution.
CH07_F11_Kunapuli

Use the distribution-comparison figure to see why compound distributions capture both the zero spike and the positive right-skewed tail. section 7.3.1

How Ensemble Methods for Machine Learning covers it

How deep it goes
Explains the Poisson and gamma components and identifies 1 < p < 2, but does not derive the likelihood or internals.
Examples
Uses rainfall and UCI Bike Sharing casual-user counts to illustrate zero-heavy, right-skewed targets.
What you can do after
Apply it via LightGBM or XGBoost by selecting Tweedie objectives for suitable hybrid targets.
How it connects
Connects Poisson, gamma, Tweedie distributions, generalized linear models, log-link functions, LightGBM, and XGBoost.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Ensemble Methods for Machine Learning. The section links point to the parts of the book it draws on.