Revenue management balances price and demand over a limited selling window. Price too high and inventory may remain unsold; price too low and it may sell out before customers willing to pay more arrive. section 3.3
For a perishable product, the decision can be modeled as a sequential pricing problem: choose a price each period while tracking time and inventory. Demand responds to price, may rise as the deadline approaches, and includes random variation. Unsold items can incur a penalty. section 3.3
Table 3.2 Elements of Markov decision process for perishable dynamic pricing
|
Markov decision process elements
|
Definitions
|
|
State
|
How many sales periods are left.
How many items are left to sell.
|
|
Action
|
The agent chooses a
price from a predefined list, e.g., [8, 10, 12, 15, 18].
|
|
Reward
|
Calculated as the revenue from sales in that period.
Penalty if items remain unsold after the last period.
|
|
Transition Dynamics
|
Demand drops as the price increases (price sensitivity).
Demand slightly increases over time due to
urgency (people rush to buy near the end).
Random noise is added to simulate uncertainty.
|
The MDP table maps the business decision to states, price actions, sales rewards, and uncertain demand. section 3.3
A fixed-inventory model assumes no restocking and treats deadline urgency as natural. It does not account for customers learning to wait for late discounts, a possible strategic response. section 3.3
