PLM негізіндегі метрикалар
metric
ID: plmbasedmetrics
Related Papers
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
AbstractAutomatic evaluation metrics are crucial to the development of generative systems. In recent years, pre-trained language model (PLM) based metrics, such as BERTScore, have been commonly adopted in various generation …...
Toward Human-Like Evaluation for Natural Language Generation with Error Analysis
AbstractThe pretrained language model (PLM) based metrics have been successfully used in evaluating language generation tasks. Recent studies of the human evaluation community show that considering both major errors (e.g. …...