Automated Evaluation
Related Papers
Using machine learning for system-internal evaluation of transferred linguistic representations
AbstractWe present an automated, system-internal evaluation technique for linguistic representations in a large-scale, multilingual MT system. We use machine-learned classifiers to recognize the differences between linguistic representations generated from transfer …...
Empirical analysis of exploiting review helpfulness for extractive summarization of online reviews
We propose a novel unsupervised extractive approach for summarizing online reviews by ex- ploiting review helpfulness ratings. In addition to using the helpfulness ratings for review-level filtering, we suggest using …...
An Automatic Tool For Language Evaluation
AbstractThe aim of evaluating children speech and language is to measure their communication skills. In particular, the speech language pathologist is interested in determining the child’s impairments in the areas …...
Improving Automated Evaluation of Open Domain Dialog via Diverse Reference Augmentation
Multiple different responses are often plau- sible for a given open domain dialog con- text. Prior work has shown the importance of having multiple valid reference responses for meaningful and …...
Generative Language Models for Paragraph-Level Question Generation
AbstractPowerful generative models have led to recent progress in question generation (QG). However, it is difficult to measure advances in QG research since there are no standardized resources that allow …...
Evaluating Open-Domain Question Answering in the Era of Large Language Models
AbstractLexical matching remains the de facto evaluation method for open-domain question answering (QA). Unfortunately, lexical matching fails completely when a plausible candidate answer does not appear in the list of …...