ROSE

In this paper, we analyze the state of cur- rent human and automatic evaluation of topic-focused summarization in the Docu- ment Understanding Conference main task for 2005-2007. The analyses show …...

Automatic evaluation metrics are fundamen- tally important for Machine Translation, al- lowing comparison of systems performance and efficient training. Current evaluation met- rics fall into two classes: heuristic approaches, like …...