Anomaly
An anomaly is an observation, behavior, or state that deviates from an expected or typical pattern or condition.
Outlier Detection in Python
An extreme value is an observation far from the typical level of a time series, either unusually small or unusually large.
- How it is used
- Identifies unusually high or low time-series observations for investigation, including sales counts and industrial sensor readings.
- How deep it goes
- Works through IQR-based limits and threshold tuning, then contrasts fixed rules with forecast-based detection rather than deriving forecasting models.
- Examples
- Uses an injected daily sales spike, plotted against IQR limits, and industrial sensor deviations.
- What you can do after
- Apply it via Python IQR limits to flag candidate extreme values, then investigate what the flags mean.
Statistics Slam Dunk
An outlier is an observation that lies unusually far from the other observations in a distribution or dataset.
- How it is used
- Protects linear regression analyses from extreme observations that can bias model results.
- How deep it goes
- Explains visual detection, two statistical tests, and winsorization, while noting limitations of Dixon’s Q Test and Grubbs’ Test.
- Examples
- Uses NBA career win shares and player deflections, comparing scatterplots, histograms, and boxplots before and after capping values.
- What you can do after
- Diagnose/debug with it by visually identifying extreme values and capping them through winsorization before regression modeling.
The Well-Grounded Data Analyst
An outlier is an observation whose value differs substantially from the typical pattern of the other observations.
- How it is used
- Uses outliers to guide data-quality checks and uncover meaningful groups before downstream analysis.
- How deep it goes
- Demonstrates visual and record-level inspection plus a price-filtering decision, without defining a formal detection rule.
- Examples
- Uses daily e-commerce event counts, house-sale prices, and high-spending customer groups as examples.
- What you can do after
- Evaluate/understand unusual observations through visualization, record inspection, contextual hypotheses, and explicit cleaning choices.
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
An extreme value is an observation or value located unusually far toward an edge of an observed distribution.
- How it is used
- Use outlier checks during exploratory analysis to find data problems and limit values that may affect machine-learning performance.
- How deep it goes
- Explains detection through descriptive statistics, charts, and percentiles, then demonstrates winsorization and percentile-based filtering rather than formal outlier tests.
- Examples
- Uses Auto MPG numeric features, accommodation predictors capped by winsorization, and an accommodation-price target filtered with percentile bounds.
- What you can do after
- Evaluate/understand whether extreme observations are errors, legitimate cases, or candidates for capping or percentile-based exclusion.
Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains anomaly →
Data Without Labels
In DBSCAN, an outlier or noise point is an observation that is neither a core point nor reachable from a core point and therefore receives no cluster assignment.
- How it is used
- Uses anomalies to distinguish DBSCAN noise from clustered observations and to flag unusual values that may affect analysis.
- How deep it goes
- Defines noise through DBSCAN neighborhoods and gives practical detection and treatment options, without developing a formal anomaly-scoring method.
- Examples
- Uses transaction-count and rainfall extremes, a core-border-noise diagram, and Python cluster and nearest-neighbor plots.
- What you can do after
- Apply it via scikit-learn DBSCAN to inspect noise points, then evaluate whether unusual observations warrant investigation or treatment.
Starting Data Analytics with Generative AI and Python
An outlier is an observation that is unusually distant from the other values in a dataset or from an expected pattern.
- How it is used
- Flags unusual observations during data preparation and exploratory analysis, where they may distort results or signal business events.
- How deep it goes
- Defines outliers, suggests counts and visual inspection, and names contextual treatments; does not specify a numerical cutoff.
- Examples
- Uses a lone LA transaction among NY transactions, review counts over time, and review-response time distributions.
- What you can do after
- Practice/perform it by inspecting unusual records and deciding whether to accept, remove, cap, or transform them.
Read how Starting Data Analytics with Generative AI and Python explains anomaly →
Cyber Threat Hunting
An outlier is an observation that lies unusually far from the central or typical range of a data set.
- How it is used
- Uses outlier handling to reduce statistical noise while investigating anomalous network behavior and possible beaconing.
- How deep it goes
- Explains quartiles, skew, and IQR filtering with pandas listings, then stops short of fully interpreting each candidate connection.
- Examples
- Demonstrates outlier filtering on network timing data grouped by source IP, destination IP, and destination port.
- What you can do after
- Diagnose noisy network timing data with pandas and produce lower-variance connection candidates for threat investigation.
Pandas Workout: 200 exercises to make you a stronger data analyst
An outlier is an observation unusually far below or above the central range of a dataset according to a chosen criterion.
- How it is used
- Uses unusual observations to investigate precise analytical questions and assess whether changes affect rare or extreme cases.
- How deep it goes
- Explains IQR thresholds, pandas filtering, comparative analysis, boxplots, and z-score extensions without developing statistical theory.
- Examples
- Uses taxi distances and passenger counts, plus Chicago temperature readings visualized with boxplots.
- What you can do after
- Diagnose unusual observations with pandas, compare related measures, visualize extremes, and experiment with percentile or z-score criteria.
Read how Pandas Workout: 200 exercises to make you a stronger data analyst explains anomaly →
Experimentation for Engineers
An observed data point that lies unusually far from the other observations in a dataset or fitted relationship.
- How it is used
- Flags measurements that can make a response-surface regression unreliable near an assumed optimum.
- How deep it goes
- Defines visual diagnosis and range-shrinking remediation, but defers automatic bad-point detection and universal thresholds.
- Examples
- Uses a low markout-profit measurement at threshold 0.5 and order_size 3.5, then contrasts it with a later outlier-free iteration.
- What you can do after
- Diagnose questionable regression measurements and refine parameter ranges before continuing optimization.
Statistics Every Programmer Needs
An outlier is an observation that is unusually distant from the pattern represented by the rest of a dataset.
- How it is used
- Uses outlier checks when assessing data and fitting linear regression.
- How deep it goes
- Defines outliers, mentions scatterplot detection, and illustrates removal without detailing a detection procedure.
- Examples
- Removes a presumed point from eight observations and reports R² rising from 0.88 to 0.95.
- What you can do after
- Diagnose regression data by checking for outliers and evaluating their effect on model fit.
Read how Statistics Every Programmer Needs explains anomaly →
Data-Driven Cybersecurity
An outlier is an observation that lies unusually far from the expected distribution or reference pattern.
- How it is used
- Identifies deviations in cybersecurity data that may warrant threat investigation.
- How deep it goes
- Explains baseline analysis, thresholding, and false-positive review, then demonstrates clustering; it defers deeper statistical and AI analysis.
- Examples
- Uses device communication and login-behavior data to illustrate outliers in clustering plots and outputs.
- What you can do after
- Diagnose potentially unusual device behavior by applying statistical thresholds or inspecting clustering results.
The Art of AI Product Development
An outlier is a data point whose behavior or value is anomalous relative to the dominant patterns in a dataset.
- How it is used
- Detects unexpected deviations in time-series behavior and identifies users who do not fit discovered behavioral clusters.
- How deep it goes
- Defines anomalies as unexpected departures and illustrates peaks, troughs, and unmatched users without detailing detection algorithms.
- Examples
- Uses unusual clicking by a new user, a bot outside customer clusters, and a brief traffic spike as examples.
- What you can do after
- Diagnose unusual activity by investigating deviations, as with a user whose repeated clicks revealed a site-scraping bot.
Read how The Art of AI Product Development explains anomaly →
Financial AI in Practice
An outlier is a data value that is unusually distant from other observations in a dataset or distribution.
- How it is used
- Protects credit-model binning and WoE calculations from extreme values that can distort results or destabilize production performance.
- How deep it goes
- Compares capping, transformation, and dedicated bins, but does not provide implementation steps or a method for selecting among them.
- Examples
- Uses unusually high incomes, large transactions, spending spikes, and extremely wealthy borrowers as examples.
- What you can do after
- Apply capping, transformations, or dedicated bins while weighing genuine high-value signals against overfitting to rare observations.
Grokking Statistics
An outlier is an observation that differs markedly from most other observations in a dataset.
- How it is used
- Flags unusual observations and explains why median-based summaries can better represent typical values when data is skewed.
- How deep it goes
- Defines outliers through examples and standard-deviation thresholds, stopping short of formal detection methods.
- Examples
- Uses bar tabs, extreme coffee measurements, and an unlikely investment return to illustrate unusual observations.
- What you can do after
- Evaluate/understand how extreme values affect summaries and identify unusually distant observations with standard-deviation ranges.
Related concepts
- out-of-distributionincludes · Out-of-distribution describes data or inputs whose generating distribution differs materially from the distribution represented in a model’s training data.
- local outlierincludes · A local outlier is a data item that differs from other items in its nearby or comparable cluster while belonging to a common overall type.
- winsorizationaddressed by · Winsorization is a data transformation that replaces extreme observations beyond selected thresholds with less-extreme boundary values rather than removing them.
- interquartile rangeuses · The interquartile range is the difference between the third and first quartiles of a distribution, measuring the spread of its middle half.
- box-and-whisker plotused by · A box-and-whisker plot is a statistical graphic that summarizes a numerical distribution using quartiles, a median, and whiskers or markers indicating spread and potential outliers.
- contextual anomalyincludes · A contextual anomaly is an observation that is anomalous relative to its surrounding temporal, situational, or other contextual conditions.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.