An inventory constraint limits sales to the finite stock on hand. In dynamic pricing, the agent must balance earning more per item against selling through its stock within a fixed window. section 3.3
A food truck’s daily stock
A truck starts with 100 tacos and cannot sell more than it has. In the pricing environment, sales each period are capped by current inventory. section 3.3
Table 3.2 Elements of Markov decision process for perishable dynamic pricing
|
Markov decision process elements
|
Definitions
|
|
State
|
How many sales periods are left.
How many items are left to sell.
|
|
Action
|
The agent chooses a
price from a predefined list, e.g., [8, 10, 12, 15, 18].
|
|
Reward
|
Calculated as the revenue from sales in that period.
Penalty if items remain unsold after the last period.
|
|
Transition Dynamics
|
Demand drops as the price increases (price sensitivity).
Demand slightly increases over time due to
urgency (people rush to buy near the end).
Random noise is added to simulate uncertainty.
|
See how remaining inventory appears in the state alongside time left, pricing actions, rewards, and demand dynamics. section 3.3
