liveBook · Manning

Boosting

As explained in Build AI Drug Discovery Pipelines

Boosting is an ensemble technique that sequentially trains models so later models correct errors made by earlier models.

Boosting is an ensemble technique that trains models sequentially: each new learner focuses on errors made by the existing ensemble. Unlike parallel ensembles such as random forests, boosting uses this sequence to reduce bias on difficult cases while combining efficient weak learners. section 6.4.2

Gradient boosting passes error information forward through a loss function. Each iteration adjusts the next tree to improve the ensemble’s fit to the training examples, producing the XGBoost-style workflow used for molecular prediction. section 6.4.2

Drug-discovery team analogy

Imagine scientists screening compounds for binding to an RNA target. The first scientist makes initial predictions; later scientists study misclassified compounds and correct those mistakes. Their combined expertise becomes stronger on increasingly difficult candidates. section 6.4.2

Figure 6.13 Parallel ensembles train multiple independent models and average their predictions to reduce variance, while sequential ensembles like boosting train a sequence of models where each new model corrects errors made by the previous models, reducing bias.

Compare parallel ensembles, which average independent models to reduce variance, with boosting, which sequences corrective models to reduce bias. section 6.4.2

How Build AI Drug Discovery Pipelines covers it

How deep it goes
Explains weak learners, sequential error correction, and loss-driven gradient boosting updates.
Examples
Uses an RNA-target compound-screening analogy and XGBoost feature-importance metrics including gain, coverage, and frequency.
What it assumes
Assumes familiarity with ensemble methods and random forests before contrasting parallel and sequential training.
What you can do after
Apply via XGBoost to understand sequential model correction and aggregated predictions on difficult molecular cases.
How it connects
Connects boosting with ensemble methods, random forests, weak learners, loss functions, and gradient boosting.

Also explained in

Compare how 5 books explain boosting →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build AI Drug Discovery Pipelines. The section links point to the parts of the book it draws on.