Inter Coder Agreement
metric
ID: intercoderagreement
Related Papers
Designing and Evaluating a Reliable Corpus of Web Genres via Crowd-Sourcing
AbstractResearch in Natural Language Processing often relies on a large collection of manually annotated documents. However, currently there is no reliable genre-annotated corpus of web pages to be employed in …...
Establishing Annotation Quality in Multi-label Annotations
AbstractIn many linguistic fields requiring annotated data, multiple interpretations of a single item are possible. Multi-label annotations more accurately reflect this possibility. However, allowing for multi-label annotations also affects the …...