Качество аннотации
Related Papers
Paragraph Acquisition and Selection for List Question Using Amazon’s Mechanical Turk
AbstractCreating more fine-grained annotated data than previously relevent document sets is important for evaluating individual components in automatic question answering systems. In this paper, we describe using the Amazon's Mechanical …...
Partial Parsing as a Method to Expedite Dependency Annotation of a Hindi Treebank
AbstractThe paper describes an approach to expedite the process of manual annotation of a Hindi dependency treebank which is currently under development. We propose a way by which consistency among …...
Evaluation of Discourse Relation Annotation in the Hindi Discourse Relation Bank
AbstractWe describe our experiments on evaluating recently proposed modifications to the discourse relation annotation scheme of the Penn Discourse Treebank (PDTB), in the context of annotating discourse relations in Hindi …...
Automatic Refinement of Syntactic Categories in Chinese Word Structures
AbstractAnnotated word structures are useful for various Chinese NLP tasks, such as word segmentation, POS tagging and syntactic parsing. Chinese word structures are often represented by binary trees, the nodes …...
It’s All Fun and Games until Someone Annotates: Video Games with a Purpose for Linguistic Annotation
AbstractAnnotated data is prerequisite for many NLP applications. Acquiring large-scale annotated corpora is a major bottleneck, requiring significant time and resources. Recent work has proposed turning annotation into a game …...
Validating and Extending Semantic Knowledge Bases using Video Games with a Purpose
Large-scale knowledge bases are impor- tant assets in NLP. Frequently, such re- sources are constructed through automatic mergers of complementary resources, such as WordNet and Wikipedia. However, manually validating these …...
Controlled Propagation of Concept Annotations in Textual Corpora
AbstractIn this paper, we presented the annotation propagation tool we designed to be used in conjunction with the BRAT rapid annotation tool. We designed two experiments to annotate a corpus …...
On the Interaction between Annotation Quality and Classifier Performance in Abusive Language Detection
AbstractAbusive language detection has become an important tool for the cultivation of safe online platforms. We investigate the interaction of annotation quality and classifier performance. We use a new, fine-grained …...
Enhanced Entity Annotations for Multilingual Corpora
AbstractModern approaches in Natural Language Processing (NLP) require, ideally, large amounts of labelled data for model training. However, new language resources, for example, for Named Entity Recognition (NER), Co-reference Resolution …...
Quality and Efficiency of Manual Annotation: Pre-annotation Bias
AbstractThis paper presents an analysis of annotation using an automatic pre-annotation for a mid-level annotation complexity task - dependency syntax annotation. It compares the annotation efforts made by annotators using …...