liveBook · Manning

Binary tree

As explained in Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

A tree data structure in which each node has at most two child nodes.

A binary tree is a data structure whose nodes have at most two children. In gradient boosting, binary trees repeatedly partition data to improve an objective metric. section 5.4.3

A split-search workflow typically:

  • Considers each numeric feature and candidate threshold. section 5.4.3
  • Selects the split producing the greatest improvement according to an objective such as Gini impurity. section 5.4.3

Faster split search

A latitude feature can be split by testing every unique value or by testing boundaries from a 256-bin histogram. Both approaches found threshold 40.91306 and the same score, while histogram splitting reduced runtime from 46.9 seconds to about 563 milliseconds.

How Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI covers it

How deep it goes
Explains feature scanning, threshold evaluation, objective scoring, and histogram acceleration, but not complete tree construction.
Examples
Demonstrates exhaustive and 256-bin histogram splits on latitude data using Python listings.
What it assumes
Assumes numeric features, candidate thresholds, an objective function, and basic data partitioning.
What you can do after
Diagnose split-search costs and apply histogram-based candidate reduction for large numeric datasets.
How it connects
Connects binary trees with gradient boosting, decision trees, Gini impurity, and histogram splitting.

Also explained in

Compare how 4 books explain binary tree →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI. The section links point to the parts of the book it draws on.