Annotation Task
Related Papers
A Japanese Particle Corpus Built by Example-Based Annotation
AbstractThis paper is a report on an on-going project of creating a new corpus focusing on Japanese particles. The corpus will provide deeper syntactic/semantic information than the existing resources. The …...
Emotional Perception of Fairy Tales: Achieving Agreement in Emotion Annotation of Text
Emotion analysis (EA) is a rapidly developing area in computational linguistics. An EA system can be extremely useful in fields such as information retrieval and emotion-driven computer animation. For most …...
Brand Pitt: A Corpus to Explore the Art of Naming
AbstractThe name of a company or a brand is the key element to a successful business. A good name is able to state the area of competition and communicate the …...
Human annotation of ASR error regions: Is “gravity” a sharable concept for human annotators?
AbstractThis paper is concerned with human assessments of the severity of errors in ASR outputs. We did not design any guidelines so that each annotator involved in the study could …...
Extending the gold standard for a lexical substitution task: is it worth it?
We present a new evaluation scheme for the lexical substitution task. Following (McCarthy and Navigli, 2007) we conducted an annotation task for French that mixes two datasets: in the first …...
Natural Questions: A Benchmark for Question Answering Research
AbstractWe present the Natural Questions corpus, a question answering data set. Questions consist of real anonymized, aggregated queries issued to the Google search engine. An annotator is presented with a …...
GoodNewsEveryone: A Corpus of News Headlines Annotated with Emotions, Semantic Roles, and Reader Perception
AbstractMost research on emotion analysis from text focuses on the task of emotion classification or emotion intensity regression. Fewer works address emotions as a phenomenon to be tackled with structured …...
TIARA: A Tool for Annotating Discourse Relations and Sentence Reordering
AbstractThis paper introduces TIARA, a new publicly available web-based annotation tool for discourse relations and sentence reordering. Annotation tasks such as these, which are based on relations between large textual …...
A Taxonomy and Study of Critical Errors in Machine Translation
AbstractNot all machine mistranslations are equal. For example, mistranslating a date or time in an appointment, mistranslating the number or currency in a contract, or hallucinating profanity may lead to …...