Evaluation Task

The Natural Language Generation com- munity is currently engaged in discussion as to whether and how to introduce one or several shared evaluation tasks, as are found in other fields …...

This paper presents the results of the WMT09 shared tasks, which included a translation task, a system combination task, and an evaluation task. We con- ducted a large-scale manual evaluation …...

This paper presents the results of the WMT10 and MetricsMATR10 shared tasks,1 which included a translation task, a system combination task, and an eval- uation task. We conducted a large-scale …...

Sentiment ambiguous adjectives cause major difficulties for existing algorithms of sentiment analysis. We present an evaluation task designed to provide a framework for comparing different approaches in this problem. We …...

Researchers working on distributional semantics have recently taken up the challenge of going beyond lexical meaning and tackle the issue of compositionality. Several Compositional Distribu- tional Semantics Models (CDSMs) have …...

When machine translation researchers par- ticipate in evaluation tasks, they typically design their primary submissions using ideas that are not genre-specific. In fact, their systems look much the same from …...

AbstractWe perform an interdisciplinary large-scale evaluation for detecting lexical semantic divergences in a diachronic and in a synchronic task: semantic sense changes across time, and semantic sense changes across domains. …...