Crowdsourced Data
Related Papers
The Benefits of a Model of Annotation
AbstractStandard agreement measures for interannotator reliability are neither necessary nor sufficient to ensure a high quality corpus. In a case study of word sense annotation, conventional methods for evaluating labels …...
Learning Emphasis Selection for Written Text in Visual Media from Crowd-Sourced Label Distributions
AbstractIn visual communication, text emphasis is used to increase the comprehension of written text to convey the author’s intent. We study the problem of emphasis selection, i.e. choosing candidates for …...
Let Me Choose: From Verbal Context to Font Selection
AbstractIn this paper, we aim to learn associations between visual attributes of fonts and the verbal context of the texts they are typically applied to. Compared to related work leveraging …...
Dialogue in the Wild: Learning from a Deployed Role-Playing Game with Humans and Bots
Much of NLP research has focused on crowd- sourced static datasets and the supervised learning paradigm of training once and then evaluating test performance. As argued in de Vries et …...
Work Hard, Play Hard: Collecting Acceptability Annotations through a 3D Game
AbstractCorpus-based studies on acceptability judgements have always stimulated the interest of researchers, both in theoretical and computational fields. Some approaches focused on spontaneous judgements collected through different types of tasks, …...