Pairwise Comparisons

In this paper we address the problem of choosing the best solution(s) from a set of interpretations of the same object (in our case a segment of text). A notion …...

A machine learning mechanism is learned from human annotations in order to perform preference ranking. The mechanism operates on a sentence level and ranks the alternative machine translations of each …...

Machine translation (MT) systems can only be improved if their performance can be reli- ably measured and compared. However, mea- surement of the quality of MT output is not straightforward, …...

A main output of the annual Workshop on Statistical Machine Translation (WMT) is a ranking of the systems that partici- pated in its shared translation tasks, pro- duced by aggregating …...

This paper describes the AMBRA system, entered in the SemEval-2015 Task 7: ‘Di- achronic Text Evaluation’ subtasks one and two, which consist of predicting the date when a text was …...

AbstractConcept map-based multi-document summarization has recently been proposed as a variant of the traditional summarization task with graph-structured summaries. As shown by previous work, the grouping of coreferent concept mentions …...

AbstractThe inability to quantify key aspects of creative language is a frequent obstacle to natural language understanding. To address this, we introduce novel tasks for evaluating the creativeness of language—namely, …...