liveBook · Manning

SMOTE

As explained in The AI Pocket Book

A data augmentation technique that generates additional minority-class examples by combining existing ones.

SMOTE is a data augmentation technique that makes extra minority-class training examples by combining existing ones. It is used when one class, like fraud, appears too rarely in the data. section 1.27

The basic move is simple: take the small pile of underrepresented examples and synthesize more of them from what is already there. The warning is just as simple: it does not create new information, so it may be a band-aid for a poorly framed task. section 1.27

What it does and does not do:

  • Generates more examples of an underrepresented category. section 1.27
  • Combines existing examples instead of collecting new ones. section 1.27
  • Adds no new information to the training data. section 1.27

Fraud detection

A model for credit card fraud may have very few fraud-labeled transactions. SMOTE creates additional fraudulent examples by combining existing ones so the minority class is less sparse. section 1.27

How The AI Pocket Book covers it

How deep it goes
Explains the basic mechanism and its limitation, but stops short of a detailed algorithm.
Examples
Uses credit card fraud as the concrete example and contrasts it with other fake-data ideas.
What it assumes
Assumes basic familiarity with training data and class imbalance, while defining the idea from scratch.
What you can do after
Apply it to reduce class imbalance in a training set, while recognizing it cannot invent new signal.
How it connects
Ties to machine learning, training data, underrepresented category, and fraud detection.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of The AI Pocket Book. The section links point to the parts of the book it draws on.