liveBook · Manning

Evaluation

As explained in Applied Reinforcement Learning

The assessment of a system's performance using evidence and criteria intended to distinguish effective behavior from misleading results.

Evaluation tests whether an agent’s apparent success reflects useful behavior or luck. In portfolio management, assess it on later, unseen market history, using consistent conditions and measures that account for risk—not return alone. section 12.7 section 12.9.5

A credible comparison should:

  • Compare against challenging baselines, change one variable at a time, and aggregate results across many starting points or episodes. section 12.7 section 12.9.5
  • Report measures such as Sharpe ratio, worst drawdown, and turnover rather than relying on bare returns. section 12.7 section 12.9.5
  • Measure intermediate links in the causal chain: for example, compare each signal with an oracle using mean error and directional accuracy. section 12.7

When identical results are a warning

If agents given different signals produce byte-for-byte identical results, do not assume the system is reproducible and sound. Check that the signal inputs really differ, then investigate whether the policy is ignoring them. section 12.7

How Applied Reinforcement Learning covers it

How deep it goes
Specifies held-out testing, controlled comparisons, aggregation, risk-adjusted metrics, and signal-fidelity checks, without detailing statistical tests.
Examples
Uses portfolio modes with different signals, shared market conditions, and an oracle comparison; identical outputs expose possible signal neglect.
What you can do after
Diagnose whether an agent uses its inputs and compare performance under controlled, risk-aware tests.
How it connects
Connects held-out testing, baseline comparison, risk-adjusted metrics, signal fidelity, and causal-chain analysis.

Also explained in

Compare how 29 books explain evaluation →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Applied Reinforcement Learning. The section links point to the parts of the book it draws on.