liveBook · Manning

Area under the ROC curve

Also called AUC, area under the curve

Area under the ROC curve is a classification metric that measures how well a scoring model ranks positive examples above negative examples across decision thresholds.

How 14 Manning books explain it

Build AI Drug Discovery Pipelines

AUC is the area under the receiver operating characteristic curve and measures ranking-based discrimination between classes.

How it is used
Uses ROC AUC to compare classifier rankings for inhibitor detection and antibody screening.
How deep it goes
Explains ROC rates, random and perfect baselines, and the ranking interpretation without detailing an AUC calculation procedure.
Examples
Reports a test AUC of 0.8053 for a classifier distinguishing HIV-1 from SARS-CoV-2 antibody sequences.
What you can do after
Evaluate ranking discrimination against a random baseline and choose complementary checks for positive-class performance.

Read how Build AI Drug Discovery Pipelines explains area under the ROC curve →

Grokking Machine Learning

A scalar performance metric equal to the area under a receiver operating characteristic curve.

How it is used
Uses AUC to evaluate a classification model from its ROC curve.
How deep it goes
Calculates example areas by counting grid squares and compares scores, without presenting an integral formula.
Examples
Compares model AUC values of 0.52, 0.72, and 1, and discusses reversing a model with a score of 0.
What you can do after
Evaluate classification models by comparing AUC scores and use the ROC curve to choose a threshold.

Read how Grokking Machine Learning explains area under the ROC curve →

Statistics Slam Dunk

AUC is the area under a receiver operating characteristic curve, measuring a binary classifier's ability to rank positive cases above negative cases.

How it is used
Evaluates a binary classifier's overall ability to distinguish positive from negative cases during model development.
How deep it goes
Defines AUC, gives benchmark values, contrasts it with classification error, and demonstrates calculation without developing its mathematical internals.
Examples
Uses NBA playoff qualification predictions, a logistic regression, an AUC of 0.73, and ROC plots to compare models.
What you can do after
Evaluate binary classification models with pROC's roc() function and visualize their ROC curves using base R.

Read how Statistics Slam Dunk explains area under the ROC curve →

Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI

ROC AUC is the area under the receiver operating characteristic curve, measuring a binary classifier's ability to rank positive instances above negative instances.

How it is used
Evaluates binary classifiers when predicted ordering matters, particularly for imbalanced targets or adversarial validation.
How deep it goes
Defines the metric, interprets benchmark scores, and demonstrates application, but does not derive the ROC curve mathematically.
Examples
Uses synthetic-versus-original German Credit Risk data and an imbalanced price-classification target as practical evaluation contexts.
What you can do after
Evaluate binary predictions with ROC AUC and interpret scores near perfect, random, or intermediate performance.

Read how Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI explains area under the ROC curve →

Starting Data Analytics with Generative AI and Python

A metric equal to the area under a receiver operating characteristic curve that summarizes discrimination across thresholds.

How it is used
Assesses classifier effectiveness when decision thresholds are uncertain or variable.
How deep it goes
Defines AUC and its interpretation, without detailing its calculation.
Examples
Uses customer-review sentiment classification and discusses decisions across variable thresholds.
What you can do after
Evaluate classifier performance across thresholds using AUC alongside sensitivity and specificity.

Read how Starting Data Analytics with Generative AI and Python explains area under the ROC curve →

Outlier Detection in Python

AUROC is the area under the receiver operating characteristic curve, measuring a scoring model's ability to rank positive cases above negative cases across classification thresholds.

How it is used
Evaluates how well outlier detectors rank labeled outliers above inliers and supports detector or parameter comparisons.
How deep it goes
Defines ranking performance with perfect and random benchmarks, then connects AUROC to detector comparison and threshold selection.
Examples
Uses KDD Cup network events, doped data, detector comparisons, and training-size tests as evaluation examples.
What you can do after
Evaluate detector rankings against labeled data and compare detectors or parameter settings using AUROC.

Read how Outlier Detection in Python explains area under the ROC curve →

Statistics Every Programmer Needs

The area under the ROC curve is a measure of a binary classifier's ability to discriminate between positive and negative classes across classification thresholds.

How it is used
Evaluates a binary classifier’s ability to discriminate between classes across classification thresholds.
How deep it goes
Defines AUC, interprets its range, contrasts it with accuracy, and demonstrates a scikit-learn calculation.
Examples
Uses raisin classification and an imbalanced exam-pass example to contrast AUC with accuracy.
What you can do after
Apply scikit-learn’s roc_auc_score to evaluate binary-classifier discrimination.

Read how Statistics Every Programmer Needs explains area under the ROC curve →

Machine Learning System Design

The area under the receiver operating characteristic curve, summarizing ranking performance across classification thresholds.

How it is used
Uses ROC AUC to compare classifiers and assess whether datasets are distinguishable in adversarial validation.
How deep it goes
Summarizes ranking across classification thresholds and gives a rough separability signal, without deriving the calculation.
Examples
Compares fraud models with equal recall but different false-positive counts and tests whether datasets can be distinguished.
What you can do after
Evaluate model ranking or dataset distinguishability with ROC AUC, while considering false-positive burden in fraud detection.

Read how Machine Learning System Design explains area under the ROC curve →

Grokking Statistics

The area under the curve is the area beneath a receiver operating characteristic or precision-recall curve, summarizing performance across thresholds.

How it is used
Summarizes classifier performance across thresholds when one confusion matrix cannot represent every operating point.
How deep it goes
Defines ROC and PRC relationships and applies AUC to test-set evaluation, but does not derive the area mathematically.
Examples
Uses toddler-meltdown predictions, test-set ROC and PRC figures, and scikit-learn metric code.
What you can do after
Evaluate a classifier with ROC AUC or PRC-based summaries instead of relying only on accuracy.

Read how Grokking Statistics explains area under the ROC curve →

Causal Inference for Data Science

The area under the ROC curve is a threshold-independent measure of binary classification performance based on the receiver operating characteristic curve.

How it is used
Evaluates propensity-score models by ranking treated and untreated cases across thresholds.
How deep it goes
Defines ranking-based AUC and applies cross-validation, overfitting checks, and treatment-group inspection, without deriving ROC internals.
Examples
Uses patient treatment indicators, confounder tables, logistic regression, boosting, and treatment-group propensity-score density plots.
What you can do after
Evaluate propensity-score models with cross-validated AUC and diagnose overfitting or weak treatment overlap.

Read how Causal Inference for Data Science explains area under the ROC curve →

Graph Neural Networks in Action

The area under a receiver operating characteristic curve, measuring a classifier's ability to rank positive examples above negative examples across thresholds.

How it is used
Compares baseline classifiers and graph models through threshold-independent ROC performance.
How deep it goes
Defines ROC/AUC intuitively and demonstrates computation, but defers formal derivation and threshold-selection procedures.
Examples
Uses logistic regression, XGBoost, MLP, and graph-autoencoder edge prediction with validation and test scores.
What you can do after
Apply AUC via scikit-learn to compare probability predictions and evaluate graph-autoencoder link predictions.

Read how Graph Neural Networks in Action explains area under the ROC curve →

Financial AI in Practice

The area under a receiver operating characteristic curve, summarizing a classifier’s ability to distinguish between classes across thresholds.

How it is used
Measures borrower separation before a credit model’s decision cutoff and business rules are applied.
How deep it goes
Defines the ROC curve and ranking interpretation, then discusses lending benchmarks and cost limitations.
Examples
Uses defaulting versus nondefaulting borrowers and a score cutoff of 650 to illustrate credit model evaluation.
What you can do after
Evaluate and compare model ranking power while recognizing asymmetric lending costs and limitations on imbalanced fraud data.

Read how Financial AI in Practice explains area under the ROC curve →

Machine Learning Algorithms in Depth

Area under the curve is a scalar summary of the area beneath a performance curve, with larger values indicating better ranking performance in the ROC sense.

How it is used
Summarizes ROC curve quality as a single classification-performance measure.
How deep it goes
Defines AUC and its interpretation but does not derive its calculation.
Examples
Uses a figure comparing ROC and precision-recall plots.
What you can do after
Evaluate classifier ranking performance from its ROC curve summary.

Read how Machine Learning Algorithms in Depth explains area under the ROC curve →

Grokking Machine Learning, Second Edition

AUC is the area under a receiver operating characteristic curve, measuring how well a binary classifier distinguishes between its classes across decision thresholds.

How it is used
Evaluates binary classifiers across thresholds and supports decisions about balancing sensitivity and specificity.
How deep it goes
Calculates ROC area through a grid example and interprets benchmark values, without developing a formal computation procedure.
Examples
Compares three ROC curves with AUC values of 0.52, 0.72, and 1 using counted grid squares.
What you can do after
Evaluate a binary classifier and choose thresholds by reading ROC behavior and comparing AUC values.

Read how Grokking Machine Learning, Second Edition explains area under the ROC curve →

Also covered in

What to know first

Related concepts

Questions about area under the ROC curve

What is area under the ROC curve?

Area under the ROC curve is a classification metric that measures how well a scoring model ranks positive examples above negative examples across decision thresholds.

Which Manning books explain area under the ROC curve?

Build AI Drug Discovery Pipelines, Grokking Machine Learning, Statistics Slam Dunk, Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI, Starting Data Analytics with Generative AI and Python, Outlier Detection in Python, Statistics Every Programmer Needs, Machine Learning System Design and 6 more.

What should I know before learning area under the ROC curve?

Manning books that teach area under the ROC curve usually introduce accuracy, recall, classifier and confusion matrix first.

What is the difference between area under the ROC curve and AUC-PR?

Area under the ROC curve is a classification metric that measures how well a scoring model ranks positive examples above negative examples across decision thresholds. AUC-PR is the area under a precision-recall curve, summarizing the trade-off between precision and recall across classification thresholds.

What is area under the ROC curve also called?

Area under the ROC curve is also called AUC or area under the curve.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.