XGBoost
XGBoost is an open-source software library for efficient gradient-boosted decision-tree algorithms used in supervised machine learning.
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
A predictive model trained using XGBoost's gradient-boosted decision-tree algorithms.
- How it is used
- Applies gradient-boosted trees as a strong baseline for tabular classification and regression prediction.
- How deep it goes
- Explains APIs, parallel training, split algorithms, missing-value routing, growth policies, GPU use, and tree-structure extraction.
- Examples
- Uses Airbnb New York classification and Tokyo price regression, plus histogram-split timing and exported tree paths.
- What you can do after
- Apply it via the Scikit-learn API to train, cross-validate, evaluate, accelerate, and inspect tabular prediction models.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains XGBoost →
Ensemble Methods for Machine Learning
XGBoost is an open-source machine-learning library implementing scalable gradient-boosted decision-tree algorithms.
- How it is used
- Applies tree-based Newton boosting to scalable classification, regression, ranking, and custom-loss tasks.
- How deep it goes
- Explains regularized tree learning and tuning, while deferring block-based system-design details.
- Examples
- Uses multiclass document retrieval, pseudo-Huber regression, and bike-rental prediction with randomized hyperparameter search.
- What you can do after
- Apply it via XGBClassifier or XGBRegressor with randomized cross-validation, regularization, and evaluation-based early stopping.
Read how Ensemble Methods for Machine Learning explains XGBoost →
Grokking Machine Learning
An open-source software library that implements optimized gradient-boosted decision trees for machine-learning tasks.
- How it is used
- Deploys boosted decision-tree ensembles for regression and classification tasks.
- How deep it goes
- Explains residual fitting, similarity scores, split selection, pruning, learning rates, predictions, and a Python configuration.
- Examples
- Uses app engagement by age, residual tables, tree diagrams, pruning comparisons, prediction plots, and an XGBRegressor listing.
- What you can do after
- Apply XGBoost via the xgboost package and inspect how successive trees reduce residual errors.
Machine Learning Platform Engineering
An XGBoost model is a gradient-boosted decision-tree model trained using the XGBoost algorithm.
- How it is used
- Supports production-oriented model comparison by tracking XGBoost datasets, parameters, metrics, models, and artifacts with MLflow.
- How deep it goes
- Demonstrates DMatrix construction, binary objectives, hyperparameters, boosting rounds, predictions, and feature-importance plots.
- Examples
- Uses income-classifier train/test datasets, binary logistic and hinge objectives, prediction outputs, and importance plots.
- What you can do after
- Apply it via XGBoost and MLflow to train, inspect, and automatically record a binary classification model.
Read how Machine Learning Platform Engineering explains XGBoost →
Delivering Machine Learning Projects: From design to deployment
XGBoost is an open-source implementation of gradient-boosted decision trees for efficient supervised learning.
- How it is used
- Deploys gradient-boosted trees for robust tabular modeling, baseline comparison, or denoising before explainable modeling.
- How deep it goes
- Explains practical strengths, interpretability costs, and data-type limitations without detailing boosting mechanics or implementation steps.
- Examples
- Uses XGBoost as a tabular-data model, a denoiser for simpler models, and a baseline for explainability costs.
- What you can do after
- Apply it to tabular prediction, benchmark explainable alternatives, or filter noise before simpler modeling.
Read how Delivering Machine Learning Projects: From design to deployment explains XGBoost →
Financial AI in Practice
XGBoost is an open-source software library for gradient-boosted decision trees.
- How it is used
- Uses XGBoost as a baseline tree-based model within a manual WoE credit-scoring pipeline.
- How deep it goes
- Places XGBoost after WoE feature transformation but does not detail its training mechanics.
- Examples
- Applies XGBoost to WoE-coded features in a credit-default workflow with a 100,000-row, 919-column dataset.
- What you can do after
- Apply XGBoost as a baseline classifier on WoE-transformed credit features and evaluate it with cross-validation and confusion matrices.
Related concepts
- decision treeuses · A decision tree is a branching structure that represents sequential tests or choices, with paths leading to outcomes, predictions, or actions.
- gradient boostingimplements · Gradient boosting is an ensemble-learning technique that sequentially adds predictive models, typically weak learners, to reduce a loss by fitting its gradient.
- weighted quantile sketchuses · A weighted quantile sketch is an approximate algorithm for estimating quantiles or quantile-based split points while accounting for item weights.
- early stoppinguses · Early stopping is a technique that terminates an iterative process before its planned completion when a specified condition indicates that further work is unnecessary or unlikely to improve the objective.
- LightGBMcontrasts with · LightGBM is an open-source gradient-boosting framework for efficiently training tree-based machine-learning models.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.