liveBook · Manning

Machine setup

As explained in Applied Reinforcement Learning

A machine setup is the configuration of production equipment required to manufacture a particular product.

A machine setup is the production-line configuration needed to make a product. In a factory producing scooters and bikes, changing dies and balancing the line prepare it for production. The model tracks the current setup and charges a cost when production switches products. section 2.5

Listing 2.4 Factory problem definition
Class FactoryProblemDefinition:
    lambda_scooter = 4.0 #A
    lambda_bike = 3.0 #A
    horizon = 30   #A
 
    prod_capacity_scooter = 8 #B
    prod_capacity_bike = 6 #B
 
    price_scooter = 40.0 #C
    price_bike = 50.0 #C
    cost_scooter = 20.0  #C
    cost_bike = 25.0  #C
 
    setup_cost = 200.0    #D
    holding_cost = 2.0    #D
    backorder_cost = 10.0 #D

Factory parameters set the setup cost at $200, alongside production, holding, and backorder costs. section 2.5

How Applied Reinforcement Learning covers it

How deep it goes
Defines setup as production preparation, tracks it across actions, and applies a switching penalty without detailing setup operations.
Examples
Uses switching between scooter and bike production, with a $200 setup cost in the factory parameters.
What you can do after
Understand how setup becomes a state variable and switching cost in a production-planning model.
How it connects
Connects machine setup to Markov decision processes, production planning, state transitions, actions, and reward functions.

This explainer was generated by Manning's knowledge graph from the text of Applied Reinforcement Learning. The section links point to the parts of the book it draws on.