liveBook · Manning

Chapter 1: Real-world Decision Making with Reinforcement Learning

What you will learn in chapter 1 of Applied Reinforcement Learning

The introduction frames business decisions as repeated choices under uncertainty and connects that challenge to reinforcement learning.

After this chapter you will be able to

Section by section

Introduction

The introduction frames business decisions as repeated choices under uncertainty and connects that challenge to reinforcement learning.

Key terms: limited resources, uncertainties, strengths and weaknesses, opportunities and threats, sequential decisions, uncertainty, reinforcement learning

1.1 What reinforcement learning really enables?

This section introduces reinforcement learning as learning actions from experience and contrasts it with other machine learning approaches for business decisions.

Key terms: agent, environment, policies, AlphaStar, explore, cumulative outcomes, long-term value, credit assignment, rewards, penalties

1.2 Different types of business analysis

This section distinguishes business analysis questions by time frame and degree of control, and contrasts model-based and data-driven ways to answer them.

Key terms: external factors, internal factors, partial control, Descriptive Analysis, Prediction, Forecasting, Explanatory Analysis, Optimization, Model-based, Data-driven

1.3 Business optimization definition

This section outlines when business optimization is typically useful and defines the inputs, objectives, constraints, and outputs of an optimization model.

Key terms: decision level, decision cycle, decision dimensions, decision quantifiability, external factors, parameters, actions, decision variables, sensitivity analysis, objective

1.4 Examples of business optimization problems

This section illustrates recurring business optimization problems and their shared structure through operational examples.

Key terms: business optimization, operational, recurring, quantifiable, inventory replenishment, demand forecasts, supplier lead times, order quantities, service level agreement, vehicle routing

1.5 Challenges in business optimization problems

This section explains how bias, variance, and practical constraints affect the quality of business optimization models.

Key terms: variance, bias, process quality, trade-off, constraints, modeling approach

1.6 Classical business optimization models

This section introduces classical modeling methods as longstanding foundations of business decision-making systems.

1.6.1 Operations research

This section introduces operations research through a bakery optimization problem, distinguishes three model types, and describes the role of solvers.

Key terms: operations research, decision variables, objective function, constraints, linear programming, LP, mixed integer programming, MIP, nonlinear programming, NLP

1.6.2 Stochastic simulation

This section explains how stochastic and discrete event simulations explore business systems under uncertainty, using a coffee shop as an example.

Key terms: stochastic simulation, uncertainty, key performance indicators, queueing theory, stochastic processes, Monte Carlo simulation, statistical inference modeling, probability distributions, risk exposure, discrete event simulation

1.6.3 System dynamics

This section explains how system dynamics models feedback and changes over time to support long-term business decisions.

Key terms: system dynamics, feedback, time-delayed relationships, causal loop diagram, reinforcing loops, balancing loops, stock-and-flow diagrams, stocks, flows, differential equations

1.6.4 Game theory

This section explains how game theory models interdependent business decisions and defines Nash equilibrium as a stable balance of strategies.

Key terms: Game Theory, players, strategic decision-making, objectives, Nash Equilibrium, strategies, unilaterally

1.7 Reinforcement learning for business optimization

This section explains how reinforcement learning learns adaptive business decisions through interaction, long-term feedback, and trial and error, while recognizing when simpler approaches may be preferable.

Key terms: agent, environment, state, action, reward, policy, long-term planning, sequential decisions, delayed consequences, short-term rewards

1.8 Limitations in classical models and reinforcement learning

This section compares classical optimization with reinforcement learning, explaining their complementary strengths and practical limitations.

Key terms: classical models, constraints, reinforcement learning, feedback, adaptability, decision variables, objective functions, trade-offs, interactions, simulations

1.9 Summary

Where this is used later

Concepts explained in this chapter

Chapter 2: Markov Decision Process: Turning Problems intro Solvable Models →

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.