Benchmark Task
task
ID: benchmarktask
Related Papers
How Much Information Does a Human Translator Add to the Original?
We ask how much information a human translator adds to an original text, and we provide a bound. We address this ques- tion in the context of bilingual text com- …...
Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards?
AbstractLeaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and …...