A limited selling window is the fixed period in which inventory can be sold while customers still want it. After the deadline, unsold goods may become worthless; for seasonal items, demand can instead drop sharply. Pricing must balance earning more per sale against selling enough before time runs out. section 3.3
Table 3.2 Elements of Markov decision process for perishable dynamic pricing
|
Markov decision process elements
|
Definitions
|
|
State
|
How many sales periods are left.
How many items are left to sell.
|
|
Action
|
The agent chooses a
price from a predefined list, e.g., [8, 10, 12, 15, 18].
|
|
Reward
|
Calculated as the revenue from sales in that period.
Penalty if items remain unsold after the last period.
|
|
Transition Dynamics
|
Demand drops as the price increases (price sensitivity).
Demand slightly increases over time due to
urgency (people rush to buy near the end).
Random noise is added to simulate uncertainty.
|
See how the selling window shapes the pricing problem: the state tracks periods and inventory remaining, while rewards include revenue and a penalty for leftover stock. section 3.3
