Pairwise ranking loss evaluates multilabel predictions by checking whether positive labels receive higher scores than negative labels. It penalizes incorrectly ordered label pairs; lower values are better, with 0 as the best achievable result. section 5.4.2
Use ranking loss when multilabel evaluation must consider score ordering, not only final thresholded predictions:
- Compare models by the average number of incorrectly ordered label pairs. section 5.4.2
- Interpret lower scores as better ranking performance; zero means no counted ordering errors. section 5.4.2
- Check calibration when comparing rankings, especially with independent label models, complex models, or imbalanced labels. section 5.4.2
CYP inhibitor prediction
In a multilabel cytochrome P450 inhibition task, one molecule can receive several CYP labels. Ranking loss evaluates whether the model scores its true inhibitor labels above labels that should not apply. section 5.4.2
