liveBook · Manning

Limited selling window

As explained in Applied Reinforcement Learning

A limited selling window is a fixed period during which inventory can be sold before sales lose relevance or become impossible.

A limited selling window is the fixed period in which inventory can be sold while customers still want it. After the deadline, unsold goods may become worthless; for seasonal items, demand can instead drop sharply. Pricing must balance earning more per sale against selling enough before time runs out. section 3.3

Table 3.2 Elements of Markov decision process for perishable dynamic pricing
Markov decision process elements
Definitions
State
How many sales periods are left.
How many items are left to sell.
Action
The agent chooses a price from a predefined list, e.g., [8, 10, 12, 15, 18].
Reward
Calculated as the revenue from sales in that period.
Penalty if items remain unsold after the last period.
Transition Dynamics
Demand drops as the price increases (price sensitivity).
Demand slightly increases over time due to urgency (people rush to buy near the end).
Random noise is added to simulate uncertainty.

See how the selling window shapes the pricing problem: the state tracks periods and inventory remaining, while rewards include revenue and a penalty for leftover stock. section 3.3

How Applied Reinforcement Learning covers it

How deep it goes
Defines the fixed horizon and relates it to inventory, rewards, and pricing decisions without detailing domain-specific complexities.
Examples
Illustrates the window with fresh bread, flight tickets, hotel rooms, seasonal fashion, and tournament jerseys.
What you can do after
Understand how a fixed selling horizon creates a trade-off between price, demand, and leftover inventory.
How it connects
Connects dynamic pricing with perishability, price-sensitive demand, uncertainty, and inventory constraints.

This explainer was generated by Manning's knowledge graph from the text of Applied Reinforcement Learning. The section links point to the parts of the book it draws on.