An encoder-only Transformer represents a complete input sequence with bidirectional context. Unlike autoregressive decoders, it can use later words to interpret earlier ones, making it useful for comparing existing texts rather than generating new text. section 3.2.2
Semantic paraphrase comparison
The committee-approved proposal and the passage describing committee approval after lengthy discussion express similar meaning despite different wording.






