Multi-call debate evaluates competing responses through isolated advocate calls followed by a separate judging call. Isolation prevents one model from constructing both sides and quietly favoring one argument. section 10.3.3
A typical evaluation uses three calls:
- Call 1 sees the input and argues for Response A without seeing the opposing argument. section 10.3.3
- Call 2 sees the input and argues for Response B without seeing the first argument. section 10.3.3
- Call 3 sees the finished arguments, not the raw responses, and judges which case withstands scrutiny better. section 10.3.3
The technique reduces self-preference and argument-leakage risks, but increases cost and makes advocate assignment a confounding variable. Unequal advocate strength can make the evaluation measure arguing ability rather than response quality. section 10.3.3
