liveBook · Manning

Exclusive feature bundling

Exclusive feature bundling is a tree-learning optimization that groups sparse, mutually exclusive features to reduce the effective feature dimensionality.

How 2 Manning books explain it

Ensemble Methods for Machine Learning

Feature bundling is a tree-learning optimization that groups compatible features to reduce the effective number of features processed.

How it is used
Speeds LightGBM training when high-dimensional data makes tree-split search and histogram construction expensive.
How deep it goes
Defines feature bundling’s purpose and contrast with GOSS but stops short of detailing the bundling algorithm or implementation.
Examples
Uses LightGBM, available for Python and R, as the concrete tooling context for applying EFB.
What you can do after
Evaluate how LightGBM reduces feature-processing costs through EFB when scaling gradient-boosting training.

Read how Ensemble Methods for Machine Learning explains exclusive feature bundling →

Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

Exclusive feature bundling is a feature-dimensionality-reduction technique that groups sparse, mutually exclusive features while preserving their nonzero information.

How it is used
Reduces sparse feature dimensionality to accelerate LightGBM computations while retaining nonzero information.
How deep it goes
Explains sparse encoding, two-feature bundling, and greedy approximation, but does not detail the complete algorithm.
Examples
Uses two sparse features, A and B, to demonstrate separated value ranges after bundling.
What you can do after
Apply it via LightGBM to reduce sparse feature columns without discarding nonzero signals.

Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains exclusive feature bundling →

What to know first

Related concepts

Questions about exclusive feature bundling

What is exclusive feature bundling?

Exclusive feature bundling is a tree-learning optimization that groups sparse, mutually exclusive features to reduce the effective feature dimensionality.

Which Manning books explain exclusive feature bundling?

Ensemble Methods for Machine Learning and Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI.

What should I know before learning exclusive feature bundling?

Manning books that teach exclusive feature bundling usually introduce gradient boosting first.

What is the difference between exclusive feature bundling and one-hot encoding?

Exclusive feature bundling is a tree-learning optimization that groups sparse, mutually exclusive features to reduce the effective feature dimensionality. One-hot encoding represents a categorical value as a binary vector with one active component identifying its category and all other components inactive.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.