Бағалау әдістері
Related Papers
MT evaluation: old, new, and recycled
AbstractThe tutorial addresses the issues peculiar to machine translation evaluation, namely the difficulty in determining what constitutes correct translation, and which types of evaluation are the most meaningful for evaluation …...
Best Analysis Selection in Inflectional Languages
Ambiguity is the fundamental property of natural language. Perhaps, the most bur- densome case of ambiguity manifests itself on the syntactic level of analysis. In order to face up to …...
Adversarial Scrubbing of Demographic Information for Text Classification
AbstractContextual representations learned by language models can often encode undesirable attributes, like demographic associations of the users, while being trained for an unrelated target task. We aim to scrub such …...
Achieving Reliable Human Assessment of Open-Domain Dialogue Systems
AbstractEvaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation …...