liveBook · Manning

Adversarial problem

An adversarial problem is a setting in which opposing agents or processes strategically adapt their actions while pursuing conflicting objectives.

How 2 Manning books explain it

Applied Reinforcement Learning

An adversarial environment is an environment in which other agents or processes can react strategically to the decision maker's actions.

How it is used
Frames bandit decisions for auctions, feeds, and other settings where competing agents or processes react to actions.
How deep it goes
Defines strategic reaction, contrasts it with stable stochastic rewards, and names EXP3 without deriving its mechanics.
Examples
Uses ad auctions, reactive competitors, changing ranking algorithms, and bad actors gaming social feeds as concrete cases.
What you can do after
Apply it via EXP3 when reward conditions react strategically and classical stable-environment assumptions become unreliable.

Read how Applied Reinforcement Learning explains adversarial problem →

How Large Language Models Work

An adversarial environment is an environment in which other agents intentionally act in ways that oppose or exploit the system's objectives.

How it is used
Frames LLM deployment as a risk assessment when users can deliberately seek failures or exploit unexpected behavior.
How deep it goes
Explains repeated exploitation, novelty, and adaptation limits through examples, but stops short of detailing attack methods or guardrail design.
Examples
Uses an unusual-move Go bot and a repeated improper-loan prompt to illustrate exploitation.
What you can do after
Evaluate whether an LLM can withstand novelty and repeated misuse, then identify where additional guardrails are needed.

Read how How Large Language Models Work explains adversarial problem →

Also covered in

Related concepts

Questions about adversarial problem

What is adversarial problem?

An adversarial problem is a setting in which opposing agents or processes strategically adapt their actions while pursuing conflicting objectives.

Which Manning books explain adversarial problem?

Applied Reinforcement Learning and How Large Language Models Work.

What is the difference between adversarial problem and language model?

An adversarial problem is a setting in which opposing agents or processes strategically adapt their actions while pursuing conflicting objectives. A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.