Best Worst Scaling
Related Papers
Capturing Reliable Fine-Grained Sentiment Associations by Crowdsourcing and Best–Worst Scaling
Access to word–sentiment associations is use- ful for many applications, including senti- ment analysis, stance detection, and linguistic analysis. However, manually assigning fine- grained sentiment association scores to words has …...
Happy Accident: A Sentiment Composition Lexicon for Opposing Polarity Phrases
AbstractSentiment composition is the determining of sentiment of a multi-word linguistic unit, such as a phrase or a sentence, based on its constituents. We focus on sentiment composition in phrases …...
Emotion Intensities in Tweets
AbstractThis paper examines the task of detecting intensity of emotion from text. We create the first datasets of tweets annotated for anger, fear, joy, and sadness intensities. We use a …...
Understanding Emotions: A Dataset of Tweets to Study Interactions between Affect Categories
Human emotions are complex and nuanced. Yet, an overwhelming majority of the work in automatically detecting emotions from text has focused only on classifying text into positive, negative, and neutral …...
Litescale: A Lightweight Tool for Best-worst Scaling Annotation
AbstractBest-worst Scaling (BWS) is a methodology for annotation based on comparing and ranking instances, rather than classifying or scoring individual instances. Studies have shown the efficacy of this methodology applied …...
Ruddit: Norms of Offensiveness for English Reddit Comments
AbstractOn social media platforms, hateful and offensive language negatively impact the mental well-being of users and the participation of people from diverse backgrounds. Automatic methods to detect offensive language have …...
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries
AbstractCurrent pre-trained models applied for summarization are prone to factual inconsistencies that misrepresent the source text. Evaluating the factual consistency of summaries is thus necessary to develop better models. However, …...