BERTScore
An evaluation metric that compares texts by embedding similarity rather than exact overlap.
BERTScore evaluates generated text by computing cosine similarity between contextual embeddings of candidate and reference tokens, using a pretrained language model such as BERT. Unlike BLEU or ROUGE, which require exact n-gram matches, BERTScore rewards paraphrases and synonyms that carry the same meaning, making it stronger for tasks like summarization and translation where wording naturally varies. On the AIF-C01 exam, the key distinction is that BERTScore is a model-based metric rather than a surface-level string-matching one. When evaluating foundation model outputs, it is more computationally expensive than ROUGE but substantially more sensitive to semantic quality.
PlayPrepHQ study notes are written and reviewed against primary exam sources. How we create & review content →