Equality checking verifies whether a model's free-form mathematical answer is equivalent to a reference expression. In a verification pipeline, extracted answers are normalized before SymPy compares them symbolically. section 3.10
The implementation follows three linked steps:
- Extract the candidate answer by locating boxed content and applying fallbacks when the expected box is missing. section 3.10
- Normalize different answer formats by stripping LaTeX and converting mathematical notation. section 3.10
- Use SymPy to compare the normalized expressions symbolically rather than relying on textual equality. section 3.10
Math-answer verification
A verifier can process answers from the MATH-500 dataset by extracting boxed responses, normalizing their notation, and checking mathematical equivalence with SymPy. section 3.10
