liveBook · Manning

Semi-supervised learning

As explained in Financial AI in Practice

Semi-supervised learning uses a limited amount of labeled data together with a larger pool of unlabeled data.

Fraud detection often has few labeled fraud cases and a much larger pool of unlabeled, mostly legitimate transactions. Semi-supervised learning uses both pools to reduce reliance on expensive manual labeling while exposing a model to more data patterns. section 7.4.3

Two common approaches use model predictions to make unlabeled data useful:

  • Self-training: train an initial model on labeled data, add high-confidence predictions on unlabeled data to the labeled set, and retrain. section 7.4.3
  • Co-training: use multiple models, often trained on different feature subsets, to label unlabeled instances where they have high agreement or confidence. section 7.4.3

These approaches can improve performance and generalization, but the benefit is not guaranteed. Synthetic data generation is a related approach when labeled fraud data is especially scarce or lacks diversity. section 7.4.3

How Financial AI in Practice covers it

How deep it goes
Outlines self-training and co-training workflows and their potential benefits, without an implementation.
Examples
Uses labeled fraud data and mostly legitimate unlabeled transactions as the application context.
What you can do after
Evaluate how self-training and co-training can make use of scarce fraud labels.
How it connects
Connects supervised learning, class imbalance, and synthetic data generation.

Also explained in

Compare how 6 books explain semi-supervised learning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Financial AI in Practice. The section links point to the parts of the book it draws on.