Leaderboard
material
ID: leaderboard
Related Papers
Evaluation Examples are not Equally Informative: How should that change NLP Leaderboards?
AbstractLeaderboards are widely used in NLP and push the field forward. While leaderboards are a straightforward ranking of NLP models, this simplicity can mask nuances in evaluation items (examples) and …...
GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation
AbstractWhile often assumed a gold standard, effective human evaluation of text generation remains an important, open area for research. We revisit this problem with a focus on producing consistent evaluations …...