PairwiseGP is a BoTorch Gaussian-process model for learning from preferences rather than real-valued observations. Each comparison indicates which of two inputs has the higher latent function value, guiding predictions for Bayesian optimization. section 10.3
A typical training workflow is:
- Construct PairwiseGP(train_x, train_comp) and evaluate it with PairwiseLaplaceMarginalLogLikelihood, which handles the specialized likelihood of comparisons. section 10.3
- Fit the marginal log likelihood with fit_gpytorch_mll to obtain the GP posterior that best explains the observed preferences. section 10.3
Interpreting a learned comparison
After observing f(−0.0374) > f(2.6822), the posterior mean favors the first input, while uncertainty decreases around both compared points.
