Rare category

Q: How deeply does Delivering Machine Learning Projects: From design to deployment cover rare category?

Explains over-representation, omission, and representativeness risks through a concrete case, without specifying remediation algorithms.

As explained in Delivering Machine Learning Projects: From design to deployment

A rare entity is an infrequently occurring subject, case, or category represented in a data set.

A rare category is an infrequently occurring entity, case, or class in a data set. Rarity can distort samples when chance over-represents cases, or create modeling blind spots when cases are absent. section 5.4.1

Treat rarity as a data-quality and representativeness risk:

Check whether unusual cases appear disproportionately because they attract attention or matter more to stakeholders. section 5.4.1
Compare recorded cases with the broader population before treating profiles as representative. section 5.4.1
Record the risk as a data-audit ticket before using predictions to guide operational interventions. section 5.4.1

Criminal-record profiles

Police databases may over-represent repeat and serious offenders because petty crime is recorded less often. Models built from these records can therefore recommend interventions unsuitable for most offenders. section 5.4.1

How Delivering Machine Learning Projects: From design to deployment covers it

Cover of Delivering Machine Learning Projects: From design to deployment

liveBook manning.com

Read Delivering Machine Learning Projects: From design to deployment on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

Machine Learning for Tabular Data: XGBoost, Deep Learning, and AIA rare class is a target category represented by a small proportion of observations in a dataset.
liveBook manning.com

Outlier Detection in PythonA minority class is a class containing substantially fewer observations than the majority class or classes in a classification dataset.

Compare how 3 books explain rare category →

Related concepts

upsamplingconfigured by · Upsampling is a process that increases the number, density, or spatial or temporal resolution of samples or values in a dataset or representation by adding, duplicating, or estimating them.
fraudincludes · Fraud is intentional deception or unauthorized activity undertaken to obtain an improper benefit or cause another party a loss.
domain knowledgeused by · Domain knowledge is specialized understanding of the concepts, facts, practices, relationships, and constraints of a particular subject area.
anomalykind of · An anomaly is an observation, behavior, or state that deviates from an expected or typical pattern or condition.
rare wordcontrasts with · A rare word is a word that occurs substantially less often than other words in a reference text collection.

This explainer was generated by Manning's knowledge graph from the text of Delivering Machine Learning Projects: From design to deployment. The section links point to the parts of the book it draws on.