Expected improvement ranks exploration candidates by predicted upside, combining the opportunity to improve with the probability of improvement and predictive uncertainty. section 12.3.2
Exploring a Transformers DVD query
For the query "transformers dvd," the highest-scoring feature vector selects a product to test with live users. Increasing theta favors more conservative or higher-upside candidates according to the configured risk preference. section 12.3.2

