Regression test
A regression test checks whether previously correct software behavior remains correct after a change.
Test Driven: Practical TDD and Acceptance TDD for Java Developers
A software test that checks whether previously working functionality remains intact after changes.
- How it is used
- Protects previously working functionality by repeatedly checking for failures as software changes.
- How deep it goes
- Defines regression testing and explains test frequency and feedback, but gives no specific test implementation.
- Examples
- Uses a test-harness mold analogy and the example of tests run after small changes.
- What you can do after
- Operate an automated test harness regularly to catch failures and narrow down when they were introduced.
Spring Start Here, Second Edition
Regression testing is repeated testing of existing functionality to verify that code changes have not broken it.
- How it is used
- Protects existing application functionality by checking it after code changes.
- How deep it goes
- Defines repeated validation and describes CI automation, without detailing how to implement individual tests.
- Examples
- Uses tests for transferMoney() scenarios and CI builds that rerun tests after developer changes.
- What you can do after
- Operate Jenkins, GitLab Actions, or GitHub Actions to run tests on changes and notify developers of failures.
Read how Spring Start Here, Second Edition explains regression test →
LLM Customization and Fine-Tuning
A test that checks whether a change has caused previously acceptable behavior or performance to deteriorate.
- How it is used
- Checks whether fine-tuning has weakened a model’s safety and refusal behavior.
- How deep it goes
- Compares fixed prompts before and after fine-tuning and identifies mitigation options for harmful permissiveness.
- Examples
- Uses a fixed set of safety and refusal prompts to compare model behavior across fine-tuning.
- What you can do after
- Evaluate whether fine-tuning has made a model more permissive in harmful ways.
Read how LLM Customization and Fine-Tuning explains regression test →
Also covered in
- Designing AI AgentsIn early access (MEAP)
- Building Reliable AI Systems
What to know first
- accuracyAccuracy is the degree to which a result agrees with a specified truth, reference, or criterion, commonly measured as the proportion of evaluated predictions that are correct.
Related concepts
- Promptfooused by · Promptfoo is an open-source tool for testing, evaluating, and comparing prompts and large language model applications.
- automated testingkind of · Automated testing is the execution and evaluation of software tests by programs or tools rather than by manually performing each test procedure.
- emulationused by · Emulation is the reproduction of a computing system’s behavior in software so that software or operations designed for that system can run in another environment.
- error analysisproduced by · Error analysis is the systematic examination of errors to identify their patterns, causes, effects, or implications for improvement.
- regressionaddresses · A regression is an unintended deterioration or loss of previously established behavior, performance, or capability following a change.
Questions about regression test
What is regression test?
A regression test checks whether previously correct software behavior remains correct after a change.
Which Manning books explain regression test?
Test Driven: Practical TDD and Acceptance TDD for Java Developers, Spring Start Here, Second Edition and LLM Customization and Fine-Tuning.
What should I know before learning regression test?
Manning books that teach regression test usually introduce accuracy first.
What kinds of regression test are there?
Kinds of regression test include functional regression test.
What is regression test a kind of?
Regression test is a kind of automated testing. Automated testing is the execution and evaluation of software tests by programs or tools rather than by manually performing each test procedure.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


