LightGBM
LightGBM is an open-source gradient-boosting framework for efficiently training tree-based machine-learning models.
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
LightGBM is an open-source gradient-boosting framework designed for efficient tree-based learning.
- How it is used
- Applies efficient gradient-boosted trees to tabular classification and regression, particularly for rapid CPU experimentation.
- How deep it goes
- Explains leaf-wise splitting, constraints, missing-value routing, pipeline evaluation, and callback-based early stopping without detailing EFB.
- Examples
- Uses an LGBMClassifier preprocessing pipeline with five-fold validation and a separate validation-set early-stopping setup.
- What you can do after
- Apply it via LightGBM's LGBMClassifier, cross-validation, validation monitoring, and early-stopping callbacks.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains LightGBM →
Ensemble Methods for Machine Learning
LightGBM is an open-source gradient-boosting library designed for efficient tree-based machine learning.
- How it is used
- Applies efficient gradient-boosted trees to classification, regression, ranking, and custom-loss tasks.
- How deep it goes
- Explains efficiency features, overfitting controls, tuning, and loss selection without detailing parallel or GPU learning.
- Examples
- Uses AUC-monitored classification, document retrieval variants, and AutoMPG regression with Huber loss.
- What you can do after
- Apply it via LightGBM and scikit-learn to tune tree ensembles, select losses, and limit overfitting.
Read how Ensemble Methods for Machine Learning explains LightGBM →
Related concepts
- pipelineuses · A pipeline is an ordered or coordinated sequence of connected processing stages or tasks that passes data, work, or results toward an outcome.
- gradient boostingimplements · Gradient boosting is an ensemble-learning technique that sequentially adds predictive models, typically weak learners, to reduce a loss by fitting its gradient.
- gradient-based one-side samplinguses · Gradient-based one-side sampling is a gradient-boosting technique that retains examples with large gradients while subsampling and reweighting examples with small gradients.
- exclusive feature bundlinguses · Exclusive feature bundling is a tree-learning optimization that groups sparse, mutually exclusive features to reduce the effective feature dimensionality.
- XGBoostcontrasts with · XGBoost is an open-source software library for efficient gradient-boosted decision-tree algorithms used in supervised machine learning.
- native categorical supportused by · Native categorical support is a model capability for processing categorical features directly without first converting them to numeric codes.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.