liveBook · Manning

Data artifact

As explained in Outlier Detection in Python

A data artifact is an unusual recorded value caused by the data-collection process rather than by the phenomenon being monitored.

A data artifact is an unusual recorded value caused by the data-collection or processing process rather than by the phenomenon being monitored. A failing or stressed sensor may produce an artifact, making it important to distinguish collection errors from genuinely unusual readings. section 1.1.5

Treat artifacts as part of anomaly investigation rather than as automatically meaningful observations:

  • Check whether an unusual value is a point anomaly, a contextual anomaly relative to other or previous readings, or a collective anomaly involving a pattern over time. section 1.1.5
  • Inspect nulls and their patterns before applying outlier detectors; missing values may reflect sensor failures, processing errors, or nonrandom conditions. section 9.1
  • Separate suspected artifacts from statistical outliers, retain indicators of what was removed or missing, and replace nulls according to their likely source before detection. section 9.1
Figure 1.1 Temperature readings from sensor data presented as a time series. The x-axis tracks time in seconds and the y-axis tracks the temperature. There is an unusually high level of fluctuation at 200 seconds and an usually low level at 800 seconds.

A sensor time series makes collection artifacts visible as abrupt fluctuation or unusually low or high readings at particular times. section 1.1.5

How Outlier Detection in Python covers it

How deep it goes
Explains artifact sources, anomaly contexts, null handling, and workflow separation, but stops short of prescribing one universal detector.
Examples
Uses industrial temperature and pressure sensors, anomalous sensor associations, time-series fluctuations, and None or NaN values.
What it assumes
Assumes basic sensor or tabular data awareness while teaching how missingness and unusual readings can arise from collection processes.
What you can do after
Diagnose suspected collection artifacts, preserve missingness indicators, and prepare affected values for subsequent outlier detection.
How it connects
Connects data artifacts with outlier detection, point anomalies, contextual anomalies, collective anomalies, null values, and missing data.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Outlier Detection in Python. The section links point to the parts of the book it draws on.