liveBook · Manning

Frequent item set-based outlier detection

As explained in Outlier Detection in Python

Frequent pattern outlier factor is an outlier-detection method that scores records from the number and support of frequent item sets they contain.

Frequent item set-based outlier detection targets primarily categorical data by finding common values or value combinations, then identifying rows containing unusually few or infrequent patterns. section 3.2.4

Frequent pattern outlier factor (FPOF) is the simpler major approach: inliers contain multiple frequent item sets, whereas outliers contain fewer and less frequent sets. Numeric and date fields require categorical binning first. section 3.2.4

A practical workflow includes:

  • Convert numeric and date values into interpretable bins. section 3.2.4
  • Score each row from the frequent item sets it contains, treating rows with unusually weak pattern support as candidate outliers. section 3.2.4

Expense and SpeedDating data

Expense records reveal frequent combinations such as a staff ID appearing with an account. A SpeedDating example mines preference bins at 0.3 minimum support; the strongest inlier and outlier rows receive contrasting FPOF scores. section 3.2.4

How Outlier Detection in Python covers it

How deep it goes
Explains FPOF logic, binning, support thresholds, and implementation, while deferring association rules to later treatment.
Examples
Uses staff expenses, binned expense values, and SpeedDating preference bins to illustrate frequent patterns and contrasting row scores.
What it assumes
Assumes tabular categorical data or transformable numeric fields, while explaining categorical preparation through binning and encoding.
What you can do after
Apply it via mlxtend's apriori implementation after binning and encoding categorical features.
How it connects
Connects categorical outlier detection with frequent item sets, binning, one-hot encoding, and association rules.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Outlier Detection in Python. The section links point to the parts of the book it draws on.