Krippendorff's Alpha
metric
ID: krippendorffsalpha
Related Papers
Weighted Krippendorff’s alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation
The question of data reliability is of first im- portance to assess the quality of manually an- notated corpora. Although Cohen’s κ is the prevailing reliability measure used in NLP, …...
Coreference Annotation Scheme and Relation Types for Hindi
AbstractThis paper describes a coreference annotation scheme, coreference annotation specific issues and their solutions through our proposed annotation scheme for Hindi. We introduce different co-reference relation types between continuous mentions …...