The discrete action bottleneck occurs when continuous or high-dimensional controls are represented as a finite set of choices. As controls multiply, even a few levels per control can create an action space too large for value-based methods to handle. section 9.1
Air-conditioning controls
With two controls in each of eight zones, five levels per control create about 152 billion actions. Coarsening to three levels still produces about 43 million choices and prevents nuanced settings, such as a fan speed of 0.73. section 9.1
