BARTScore
metric
ID: bartscore
Related Papers
Revisiting Grammatical Error Correction Evaluation and Beyond
AbstractPretraining-based (PT-based) automatic evaluation metrics (e.g., BERTScore and BARTScore) have been widely used in several sentence generation tasks (e.g., machine translation and text summarization) due to their better correlation with …...
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training
AbstractAutomatic metrics play a crucial role in machine translation. Despite the widespread use of n-gram-based metrics, there has been a recent surge in the development of pre-trained model-based metrics that …...
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis
AbstractThe pretrained language model (PLM) based metrics have been successfully used in evaluating language generation tasks. Recent studies of the human evaluation community show that considering both major errors (e.g. …...