A classifier assigns an input to one category from a predefined set. Its output is discrete, making performance measurable against labeled examples, unlike free-form generation that may require subjective judgment or parsing. section 1.0 section 1.1.1
Use classification to make a model task easier to verify:
- Convert an open-ended generation task into a multiple-choice question with a fixed option set. section 1.1.1
- Prompt the model to select one option, then record its choice and, when available, each option's log probability. section 1.1.1
- Use constrained decoding or structured output interfaces when unrestricted responses would complicate extraction. section 1.1.1
- Compare predictions with labeled answers and report accuracy rather than relying on subjective assessment of generated text. section 1.0
Multiple-choice evaluation
For “What is the capital of France?”, assign the input to A, B, C, or D. Selecting C, Paris, produces a directly verifiable classification result; its higher log probability can also indicate confidence. section 1.1.1



































