Stress test
An evaluation that subjects a system to unusually demanding, extreme, or adverse conditions to reveal weaknesses, failure modes, or operating limits.
C++ Concurrency in Action, Second Edition
Brute-force testing repeatedly executes software, often under varied or high-load conditions, to expose failures that occur only under particular execution schedules.
- How it is used
- Uses repeated execution to increase the chance of exposing bugs caused by particular multithreaded scheduling sequences.
- How deep it goes
- Explains how repetition affects confidence and details limits from test design, scheduling coverage, and platform behavior.
- Examples
- Uses repeated runs and fine-grained thread-safe queue tests as concrete illustrations.
- What you can do after
- Apply repeated test runs to seek scheduling-dependent bugs while judging confidence against test scope and platform limits.
Read how C++ Concurrency in Action, Second Edition explains stress test →
Generative AI in Action
Stress testing is the evaluation of a system under demanding, unusual, or adverse conditions to reveal weaknesses and harmful behavior.
- How it is used
- Uses deliberate testing to identify weaknesses and harmful behavior before deploying GenAI systems.
- How deep it goes
- Defines the technique and places it in a repeatable evaluation loop, but does not specify a complete stress-test design.
- Examples
- Uses customer-service chatbot risks, edge-case inputs, CheckList, and HarmBench harmful-generation tests as concrete examples.
- What you can do after
- Diagnose harmful or unexpected outputs by testing edge cases and comparing results against defined evaluation criteria.
Starting Data Analytics with Generative AI and Python
Stress testing evaluates whether a system continues to perform adequately under workloads near or beyond its expected maximum.
- How it is used
- Evaluates whether data analytics systems remain adequate near or beyond expected maximum workloads.
- How deep it goes
- Defines load-based testing and relates it to execution time, throughput, and resource utilization without detailing a testing procedure.
- Examples
- Uses bootstrap confidence intervals as an example of a computationally intensive analytics workload.
- What you can do after
- Evaluate whether performance changes preserve adequate system behavior under demanding workloads.
Read how Starting Data Analytics with Generative AI and Python explains stress test →
Building Reliable AI Systems
Stress testing evaluates a system under unusually high loads or demanding conditions to identify weaknesses and failure modes.
- How it is used
- Probes LLM robustness under demanding or adversarial conditions and complements standard evaluation.
- How deep it goes
- Describes iterative testing and refinement, but does not specify a detailed stress-testing protocol.
- Examples
- Uses generated adversarial test cases and a flash-sale scenario with tenfold traffic, rising costs, and missing cache.
- What you can do after
- Evaluate system weaknesses by combining red-teaming with standard evaluations and validating generated cases with human oversight.
Read how Building Reliable AI Systems explains stress test →
AI Governance
Stress testing evaluates system behavior under unusually severe, adversarial, or high-load conditions.
- How it is used
- Tests system prompts against edge scenarios to catch unsafe phrasing.
- How deep it goes
- Checks prompts against several edge scenarios without specifying a formal test protocol.
- Examples
- Uses angry customers, leading questions, and ambiguous claims as test scenarios.
- What you can do after
- Diagnose unsafe phrasing that may surface under challenging prompts.
Also covered in
- Architecting Autonomous Agentic SystemsIn early access (MEAP)
- PostgreSQL Mistakes and How to Avoid Them
- Machines that ThinkIn early access (MEAP)
- Architecting an Apache Iceberg Lakehouse
- Data-Driven Cybersecurity
What to know first
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- biasBias is a systematic tendency or deviation that distorts measurements, estimates, judgments, or outcomes relative to a relevant reference or target.
- hallucinationA hallucination is model-generated content that is false, fabricated, or unsupported by relevant evidence but presented as plausible or factual.
- latencyLatency is the elapsed time between initiating an operation or request and receiving its corresponding result or observable response.
Related concepts
- HTTP stress testincludes · An HTTP stress test is a test that generates many requests to a URL or service to evaluate its behavior under sustained or heavy load.
- offline evaluationpart of · Offline evaluation is the assessment of a system using prepared or previously collected data outside live interactions or production traffic.
- red-teamingused by · Red-teaming is an adversarial assessment practice that deliberately simulates attacks or uses challenging inputs to identify a system’s vulnerabilities, failures, or unsafe behavior.
Questions about stress test
What is stress test?
An evaluation that subjects a system to unusually demanding, extreme, or adverse conditions to reveal weaknesses, failure modes, or operating limits.
Which Manning books explain stress test?
C++ Concurrency in Action, Second Edition, Generative AI in Action, Starting Data Analytics with Generative AI and Python, Building Reliable AI Systems and AI Governance.
What should I know before learning stress test?
Manning books that teach stress test usually introduce language model, bias, hallucination and latency first.
What kinds of stress test are there?
Kinds of stress test include HTTP stress test and offline stress test.
What is stress test part of?
Stress test is part of offline evaluation. Offline evaluation is the assessment of a system using prepared or previously collected data outside live interactions or production traffic.
What is stress test also called?
Stress test is also called stress testing.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.




