liveBook · Manning

Bootstrap sampling

As explained in Build AI Drug Discovery Pipelines

Bootstrap sampling creates a sample by repeatedly drawing observations from a dataset with replacement.

Bootstrap sampling repeatedly draws training observations with replacement, creating diverse subsets for multiple models. Repeated observations may appear, while others remain out of bag. section 5.3.2

Within bagging and Random Forests, each decision tree trains on a bootstrap subset. Averaging or voting across trees reduces variance and smooths individual tree errors. section 5.3.2

Bootstrap sampling supports:

  • Diverse decision trees trained from different versions of the dataset. section 5.3.2
  • Out-of-bag evaluation using observations excluded from each tree’s training subset, avoiding a separate validation set. section 5.3.2

CYP inhibition classification

A RandomForestClassifier trains 200 trees with out-of-bag scoring on molecular fingerprints for cytochrome P450 inhibition classification, reporting validation and OOB metrics.

How Build AI Drug Discovery Pipelines covers it

How deep it goes
Explains resampling, variance reduction, and OOB evaluation, but does not derive sampling probabilities or implementation internals.
Examples
Demonstrates bootstrap-trained Random Forests on molecular fingerprints for cytochrome P450 inhibition prediction.
What it assumes
Assumes training data and decision trees, while defining resampling, bagging, and OOB samples.
What you can do after
Apply it via scikit-learn RandomForestClassifier and assess models with out-of-bag scores.
How it connects
Connects bootstrap sampling to bagging, Random Forests, decision trees, ensemble learning, and out-of-bag evaluation.

Also explained in

Compare how 7 books explain bootstrap sampling →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build AI Drug Discovery Pipelines. The section links point to the parts of the book it draws on.