CheckList

method ID: checklist

Related Papers

Beyond Accuracy: Behavioral Testing of NLP Models with CheckList

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractAlthough measuring held-out accuracy has been the primary approach to evaluate generalization, it often overestimates the performance of NLP models, while alternative approaches for evaluating models either focus on individual …...

37555

A Dynamic, Interpreted CheckList for Meaning-oriented NLG Metric Evaluation – through the Lens of Semantic Similarity Rating

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractEvaluating the quality of generated text is difficult, since traditional NLG evaluation metrics, focusing more on surface form than meaning, often fail to assign appropriate scores. This is especially problematic …...

26513