A binary tree is a data structure whose nodes have at most two children. In gradient boosting, binary trees repeatedly partition data to improve an objective metric. section 5.4.3
A split-search workflow typically:
- Considers each numeric feature and candidate threshold. section 5.4.3
- Selects the split producing the greatest improvement according to an objective such as Gini impurity. section 5.4.3
Faster split search
A latitude feature can be split by testing every unique value or by testing boundaries from a 256-bin histogram. Both approaches found threshold 40.91306 and the same score, while histogram splitting reduced runtime from 46.9 seconds to about 563 milliseconds.



