The [CLS] token is a special BERT token placed at the beginning of an input. Its final hidden state aggregates the sequence for a classification head, producing an output such as a similarity score or entailment class. section 2.3
Paired-text input
For two sentences, BERT receives `[CLS] The cat sat on the mat. [SEP] A feline rested on the rug. [SEP]`. Self-attention processes both sentences jointly, and the [CLS] output summarizes their relationship for prediction. section 2.3
Use the [CLS] representation with an important limitation:
- Treat it as an aggregate for a classification decision, not automatically as a standalone sentence embedding. section 2.3
- Recognize that a cross-encoder output describes the specific pair of texts and returns a score rather than an independent representation. section 2.3


