liveBook · Manning

Percentile

Also called p95, p99

A percentile is a value in an ordered dataset or distribution at or below which a specified percentage of observations lies.

How 13 Manning books explain it

Fast by Default

A percentile statistic describing the response time below which a specified proportion of service requests complete.

How it is used
Sets user-centered backend speed goals and API budgets that communicate how many requests experience slow responses.
How deep it goes
Defines p50, p95, and p99, then details realistic-load baselining and achievable p95 budget setting.
Examples
Uses a 200 ms p95, differentiated checkout endpoints, APM dashboards, and database connection-pool exhaustion.
What you can do after
Operate/configure API response-time budgets by measuring p95 under realistic load and setting achievable thresholds.

Read how Fast by Default explains percentile →

Vibe Engineering

A percentile is a distribution threshold below which a specified percentage of observed values falls.

How it is used
Uses percentiles to assess tail latency, summarize SQL similarity, and inform cache eviction choices.
How deep it goes
Works through endpoint and phase-level p99 measurements, contrasting them with averages and aggregate workload estimates.
Examples
Compares word-validation and word-of-the-day benchmarks, then separates file-loading and scanning p99 values.
What you can do after
Diagnoses slow request phases using percentile timers and prioritizes optimization with traffic frequency and mean execution time.

Read how Vibe Engineering explains percentile →

ScyllaDB in Action

95th-percentile read latency is the read-latency value at or below which 95 percent of read requests fall.

How it is used
Assesses the slowest 5% of database reads from a user-experience and performance perspective.
How deep it goes
Defines the 95th-percentile interpretation and connects it to monitoring, diagnosis, recording rules, dashboards, and alerts.
Examples
Uses database reads, a feature causing excess reads, compactions, and a 99.9-percentile speculative-retry interval.
What you can do after
Evaluate/understand slow read behavior and select a data-informed starting point for speculative retry timing.

Read how ScyllaDB in Action explains percentile →

Quantization and Fast Inference

A quantile is a value that divides a probability distribution so that a specified proportion of observations falls below it.

How it is used
Uses p95 to set user-visible latency budgets and normal quantiles to place NF4 weight levels.
How deep it goes
Explains NF4 codebook construction and latency reporting guidance, but does not specify a percentile estimation algorithm.
Examples
Reports a 9 ms vision-pipeline p95 and compares NF4, INT4, and FP4 quantization levels.
What you can do after
Evaluate user-visible latency against a p95 target while using inference-only measurements to diagnose the pipeline.

Read how Quantization and Fast Inference explains percentile →

Crack Any Codebase with AI

p99 latency is the response time below which 99 percent of measured operations complete.

How it is used
Sets per-layer response-time budgets and identifies synchronous hops most likely to delay users.
How deep it goes
Defines p99 and applies it to traces, budgets, synchronous calls, and fan-out, stopping short of statistical calculation details.
Examples
Uses a booking flow where Google Calendar and Zoom calls dominate the response while Postgres remains fast.
What you can do after
Diagnose/debug with request traces by locating blocking hops and the slowest fan-out branch.

Read how Crack Any Codebase with AI explains percentile →

Machine Learning System Design

A value that divides a probability distribution so that a specified proportion of its mass lies at or below the value.

How it is used
Guides demand-forecast targets and metrics when service levels, inventory, and out-of-stock costs matter.
How deep it goes
Explains percentile selection through forecast metrics, weighting, penalties, and baseline construction without deriving the underlying mathematics.
Examples
Uses yearly-window baseline percentiles, quantile-loss regression, rolling aggregates, SKU-price weights, and asymmetric forecast penalties.
What you can do after
Apply percentiles through quantile forecasts and metrics to compare baselines and align demand predictions with inventory priorities.

Read how Machine Learning System Design explains percentile →

AI Model Evaluation

A latency percentile is a value below which a specified proportion of observed system response times falls.

How it is used
Uses response-time percentiles to evaluate system behavior under load and protect user experience during experiments and live operation.
How deep it goes
Defines p90 and p99, explains tail latency and operational consequences, but does not detail percentile calculation algorithms.
Examples
Uses p90 and p99, backend response times, fallback states, latency experiments, and offline-to-production metric pipelines.
What you can do after
Diagnose slow request tails, configure percentile guardrails, and validate that production metrics match offline computations.

Read how AI Model Evaluation explains percentile →

Troubleshooting Java, Second Edition

P95 latency is the response-time value at or below which 95 percent of measured requests complete.

How it is used
Uses percentile latency to expose intermittent slowdowns that average response time can conceal.
How deep it goes
Defines P95, contrasts it with averages and P99, and applies it to timeout and performance investigations.
Examples
Uses a 2,000-millisecond client timeout, 2.5-second downstream P95, and traces comparing client and server durations.
What you can do after
Diagnose timeout mismatches and intermittent slowdowns by comparing percentile latency with configured thresholds.

Read how Troubleshooting Java, Second Edition explains percentile →

Rearchitecting LLMs

A percentile is a value below which a specified percentage of observations fall in an ordered distribution.

How it is used
Uses percentiles to set a robust heatmap color bound and report request-latency tails.
How deep it goes
Defines a percentile as an ordered-distribution cutoff and applies it to activation scaling and latency reporting.
Examples
Uses the 99th percentile for activation color scaling and p50, p95, and p99 for latency comparisons.
What you can do after
Evaluate activation heatmap scales and compare request latency across the distribution rather than by average alone.

Read how Rearchitecting LLMs explains percentile →

Outlier Detection in Python

A percentile is a value or rank indicating the proportion of observations at or below a specified point in an ordered dataset.

How it is used
Combines detector scores and defines robust thresholds for identifying extreme observations.
How deep it goes
Explains percentile choices, quartile formulas, thresholds, trade-offs, and Python implementations without deriving percentile algorithms.
Examples
Uses detector-score tables, 25th and 75th percentiles, 90th and 10th percentiles, IQR, and IDR examples.
What you can do after
Apply pandas quantile to aggregate scores and calculate IQR-based outlier limits with Python.

Read how Outlier Detection in Python explains percentile →

gRPC Microservices in Go

P95 latency is the 95th-percentile response latency, below which 95 percent of observed latency values fall.

How it is used
Uses percentile latency to report service performance and avoid misleading averages in production observability.
How deep it goes
Explains ordering observations and interpreting P95, then stops short of implementation formulas or percentile-estimation algorithms.
Examples
Uses sorted latency values, a 95th-percentile interpretation, and an Order-service Jaeger result of 46.79 milliseconds.
What you can do after
Evaluate service performance by interpreting P95 latency alongside request rate, error rate, traces, and database spans.

Read how gRPC Microservices in Go explains percentile →

Latency

A latency percentile is a threshold below which a specified percentage of measured requests have completed.

How it is used
Uses percentiles to characterize latency-sensitive systems and expose tail behavior hidden by averages.
How deep it goes
Defines percentile thresholds, explains tail effects in parallel systems, and demonstrates histogram and HdrHistogram measurement, without deriving percentile algorithms.
Examples
Demonstrates parallel server fanout, ping-latency histograms, and percentile plots using selected percentile levels.
What you can do after
Evaluate latency with histograms and apply HdrHistogram to extract and plot selected percentile values.

Read how Latency explains percentile →

Grokking Statistics

A percentile is a value below which a specified percentage of observations in an ordered dataset falls.

How it is used
Summarizes numerical datasets through typical values, quartiles, and robust measures of spread.
How deep it goes
Defines percentile, explains quartiles and interquartile range, and notes interpolation without deriving estimation methods.
Examples
Uses bar-tab values to calculate the 25th, 50th, and 75th percentiles and interpret their interquartile range.
What you can do after
Apply it via NumPy to calculate percentiles and interpret typical values and middle-spread ranges.

Read how Grokking Statistics explains percentile →

Also covered in

What to know first

Related concepts

Questions about percentile

What is percentile?

A percentile is a value in an ordered dataset or distribution at or below which a specified percentage of observations lies.

Which Manning books explain percentile?

Fast by Default, Vibe Engineering, ScyllaDB in Action, Quantization and Fast Inference, Crack Any Codebase with AI, Machine Learning System Design, AI Model Evaluation, Troubleshooting Java, Second Edition and 5 more.

What should I know before learning percentile?

Manning books that teach percentile usually introduce mean, service-level agreement, variance and dataset split first.

What kinds of percentile are there?

Kinds of percentile include upper quartile, fifth percentile and quartile.

What is percentile also called?

Percentile is also called p95 or p99.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.