liveBook · Manning

Stress test

Also called stress testing

An evaluation that subjects a system to unusually demanding, extreme, or adverse conditions to reveal weaknesses, failure modes, or operating limits.

How 5 Manning books explain it

C++ Concurrency in Action, Second Edition

Brute-force testing repeatedly executes software, often under varied or high-load conditions, to expose failures that occur only under particular execution schedules.

How it is used
Uses repeated execution to increase the chance of exposing bugs caused by particular multithreaded scheduling sequences.
How deep it goes
Explains how repetition affects confidence and details limits from test design, scheduling coverage, and platform behavior.
Examples
Uses repeated runs and fine-grained thread-safe queue tests as concrete illustrations.
What you can do after
Apply repeated test runs to seek scheduling-dependent bugs while judging confidence against test scope and platform limits.

Read how C++ Concurrency in Action, Second Edition explains stress test →

Generative AI in Action

Stress testing is the evaluation of a system under demanding, unusual, or adverse conditions to reveal weaknesses and harmful behavior.

How it is used
Uses deliberate testing to identify weaknesses and harmful behavior before deploying GenAI systems.
How deep it goes
Defines the technique and places it in a repeatable evaluation loop, but does not specify a complete stress-test design.
Examples
Uses customer-service chatbot risks, edge-case inputs, CheckList, and HarmBench harmful-generation tests as concrete examples.
What you can do after
Diagnose harmful or unexpected outputs by testing edge cases and comparing results against defined evaluation criteria.

Read how Generative AI in Action explains stress test →

Starting Data Analytics with Generative AI and Python

Stress testing evaluates whether a system continues to perform adequately under workloads near or beyond its expected maximum.

How it is used
Evaluates whether data analytics systems remain adequate near or beyond expected maximum workloads.
How deep it goes
Defines load-based testing and relates it to execution time, throughput, and resource utilization without detailing a testing procedure.
Examples
Uses bootstrap confidence intervals as an example of a computationally intensive analytics workload.
What you can do after
Evaluate whether performance changes preserve adequate system behavior under demanding workloads.

Read how Starting Data Analytics with Generative AI and Python explains stress test →

Building Reliable AI Systems

Stress testing evaluates a system under unusually high loads or demanding conditions to identify weaknesses and failure modes.

How it is used
Probes LLM robustness under demanding or adversarial conditions and complements standard evaluation.
How deep it goes
Describes iterative testing and refinement, but does not specify a detailed stress-testing protocol.
Examples
Uses generated adversarial test cases and a flash-sale scenario with tenfold traffic, rising costs, and missing cache.
What you can do after
Evaluate system weaknesses by combining red-teaming with standard evaluations and validating generated cases with human oversight.

Read how Building Reliable AI Systems explains stress test →

AI Governance

Stress testing evaluates system behavior under unusually severe, adversarial, or high-load conditions.

How it is used
Tests system prompts against edge scenarios to catch unsafe phrasing.
How deep it goes
Checks prompts against several edge scenarios without specifying a formal test protocol.
Examples
Uses angry customers, leading questions, and ambiguous claims as test scenarios.
What you can do after
Diagnose unsafe phrasing that may surface under challenging prompts.

Read how AI Governance explains stress test →

Also covered in

What to know first

Related concepts

Questions about stress test

What is stress test?

An evaluation that subjects a system to unusually demanding, extreme, or adverse conditions to reveal weaknesses, failure modes, or operating limits.

Which Manning books explain stress test?

C++ Concurrency in Action, Second Edition, Generative AI in Action, Starting Data Analytics with Generative AI and Python, Building Reliable AI Systems and AI Governance.

What should I know before learning stress test?

Manning books that teach stress test usually introduce language model, bias, hallucination and latency first.

What kinds of stress test are there?

Kinds of stress test include HTTP stress test and offline stress test.

What is stress test part of?

Stress test is part of offline evaluation. Offline evaluation is the assessment of a system using prepared or previously collected data outside live interactions or production traffic.

What is stress test also called?

Stress test is also called stress testing.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.