CrowdFlower
Related Papers
Crowd-based MT Evaluation for non-English Target Languages
This paper investigates the feasibility of using crowd-sourcing services for the hu- man assessment of machine translation quality of translations into non-English tar- get languages. Non-expert graders are hired through …...
The NewSoMe Corpus: A Unifying Opinion Annotation Framework across Genres and in Multiple Languages
AbstractWe present the NewSoMe (News and Social Media) Corpus, a set of subcorpora with annotations on opinion expressions across genres (news reports, blogs, product reviews and tweets) and covering multiple …...
SemEval-2015 Task 11: Sentiment Analysis of Figurative Language in Twitter
This report summarizes the objectives and evaluation of the SemEval 2015 task on the sentiment analysis of figurative language on Twitter (Task 11). This is the first sentiment analysis task …...
Crowdsourcing a Multi-lingual Speech Corpus: Recording, Transcription and Annotation of the CrowdIS Corpora
AbstractWe announce the release of the CROWDED CORPUS: a pair of speech corpora collected via crowdsourcing, containing a native speaker corpus of English (CROWDED_ENGLISH), and a corpus of German/English bilinguals …...
Crowdsourcing Ontology Lexicons
AbstractIn order to make the growing amount of conceptual knowledge available through ontologies and datasets accessible to humans, NLP applications need access to information on how this knowledge can be …...
Temporal Information Annotation: Crowd vs. Experts
AbstractThis paper describes two sets of crowdsourcing experiments on temporal information annotation conducted on two languages, i.e., English and Italian. The first experiment, launched on the CrowdFlower platform, was aimed …...
An Italian Twitter Corpus of Hate Speech against Immigrants
The paper describes a recently-created Twitter corpus of about 6,000 tweets, annotated for hate speech against immigrants, and developed to be a reference dataset for an automatic system of hate …...