A feature vector is an ordered collection of numbers that represents a state—or a state–action pair—in a form a learning algorithm can use. Feature extraction keeps selected aspects of the raw input and discards detail for tractability. In linear function approximation, each feature is multiplied by a weight, and the weighted values are summed to estimate a state–action value. section 8.1
Figure 8.3 Linear function approximation with temporal-difference learning
See how features feed a linear value estimate and connect to temporal-difference learning. section 8.1




