liveBook · Manning

Ongoing outlier detection

As explained in Outlier Detection in Python

A technique for continuously monitoring incoming or evolving data to detect outliers over an extended period.

Ongoing outlier detection monitors data over the long term so a system can reliably identify relevant outliers as they eventually appear. Unlike one-off analysis, it requires a maintainable detection process rather than a single review of current records. section 4.13

A practical system typically combines several perspectives:

  • Reformat records into aggregate tables to expose collective outliers, such as anomalous months with unusual departmental hiring totals. section 4.13
  • Represent evolving measurements as time series to identify temporal anomaly patterns that unusual individual rows may conceal. section 4.13
  • Use a broader and more diverse detector set than a one-off investigation may require, then have experts review flagged cases. section 4.13
  • Log reviewed outliers and tune scores over time so important anomaly types rank higher and unwanted flags rank lower. section 4.13

How Outlier Detection in Python covers it

How deep it goes
Explains restructuring, detector diversity, expert review, and iterative tuning, but does not specify detector algorithms or implementation code.
Examples
Uses monthly departmental hiring aggregates, sensor data, scientific readings, financial transactions, network activity, and web traffic.
What it assumes
Assumes familiarity with tabular data and outlier tests while teaching why alternative representations and ongoing evaluation are needed.
What you can do after
Operate/configure a long-term detection process that logs flags, incorporates expert review, and tunes scoring over time.
How it connects
Connects collective outliers, time series, univariate tests, multivariate tests, expert evaluation, and anomaly scoring.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Outlier Detection in Python. The section links point to the parts of the book it draws on.