An instinct is a learned or evolved behavior that eventually guides action without conscious trial and error. Repeated reinforcement can move a behavior from deliberate system-2 thought into faster system-1 behavior. section 12.3.1
Evolutionary machine learning models instincts as reusable functions:
- Evolve separate functions for distinct reinforcement-learning environments, then add those functions as operators in a new primitive set. section 12.3.2
One expression for two environments
A function evolved for Pendulum and another evolved for Mountain Car become instinct1 and instinct2. Evolution then combines them into an agent evaluated simultaneously on both environments. section 12.3.2
