liveBook · Manning

Association rule-based outlier detection

As explained in Outlier Detection in Python

An outlier-detection technique that identifies records by evaluating whether categorical associations expected from their present item sets are violated.

Association rule-based outlier detection flags categorical records that violate expected associations. It mines frequent item sets, forms rules X → Y, and identifies rows where X occurs without the expected Y. section 7.10

Two scoring perspectives are available:

  • Count rules that hold; records satisfying fewer rules appear more outlierish. section 7.10
  • Count exceptions where an antecedent is present but its consequent is absent; this approach produces interpretable rule-based explanations. section 7.10
  • Combine it with FPOF when records containing few or zero frequent item sets also matter, because exception testing can skip them. section 7.10

Categorical preference data

One-hot-encode SpeedDating preference ranges, mine frequent item sets with minimum support 0.3, and generate rules with confidence at least 0.7. A row matching attractive [21–100] but not ambitious [0–15] violates an association rule.

How Outlier Detection in Python covers it

How deep it goes
Explains frequent-itemset mining, rule evaluation, exception scoring, and FPOF limitations without deriving mining algorithms.
Examples
Uses SpeedDating preference ranges, one-hot encoded columns, and rules such as attractive preferences implying ambitious preferences.
What it assumes
Assumes categorical columns can be represented as item indicators and teaches frequent item sets and rule exceptions through the procedure.
What you can do after
Apply it via mlxtend to mine item sets, generate rules, score exceptions, and explain flagged rows with violated rules.
How it connects
Connects frequent itemset mining, association rule mining, confidence, support, one-hot encoding, and FPOF.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Outlier Detection in Python. The section links point to the parts of the book it draws on.