Crowdsourcing Experiment
Related Papers
Is Machine Translation Getting Better over Time?
Recent human evaluation of machine translation has focused on relative pref- erence judgments of translation quality, making it difficult to track longitudinal im- provements over time. We carry out a …...
Effect Functors for Opinion Inference
AbstractSentiment analysis has so far focused on the detection of explicit opinions. However, of late implicit opinions have received broader attention, the key idea being that the evaluation of an …...
Comparing Automatic and Human Evaluation of Local Explanations for Text Classification
AbstractText classification models are becoming increasingly complex and opaque, however for many applications it is essential that the models are interpretable. Recently, a variety of approaches have been proposed for …...
Using Crowdsourced Exercises for Vocabulary Training to Expand ConceptNet
AbstractIn this work, we report on a crowdsourcing experiment conducted using the V-TREL vocabulary trainer which is accessed via a Telegram chatbot interface to gather knowledge on word relations suitable …...
Crowdsourcing Relative Rankings of Multi-Word Expressions: Experts versus Non-Experts
In this study we investigate to which degree experts and non-experts agree on questions of dificulty in a crowdsourcing experiment. We ask non-experts (second language learners of Swedish) and two …...
Empathetic Dialog Generation with Fine-Grained Intents
AbstractEmpathetic dialog generation aims at generating coherent responses following previous dialog turns and, more importantly, showing a sense of caring and a desire to help. Existing models either rely on …...