Inverse document frequency (IDF) weights terms by how unusual they are across a corpus: common terms receive lower weights, while rare terms receive higher weights. It is calculated as log(total documents / documents containing the term). section 3.2.4
In BERTScore, IDF provides optional importance weighting after token embeddings are compared with cosine similarity. Matching “the” contributes little, while matching a distinctive term such as “bureaucracy” contributes more. section 3.2.4
Apply IDF weighting in BERTScore by:
- Computing the maximum semantic similarity between each reference token and candidate tokens. section 3.2.4
Weighted matching
A reference token “the” with maximum similarity 0.713 and IDF 1.27 produces weighted similarity 0.906; repeating this across tokens yields an importance-weighted BERTScore recall of 0.753.





