A Simple Three-Step Approach for the Automatic Detection of Exaggerated Statements in Health Science News
42528Authors
nan
Abstract
AbstractThere is a huge difference between a scientific journal reporting ‘wine consumption might be correlated to cancer’, and a media outlet publishing ‘wine causes cancer’ citing the journal’s results. The above example is a typical case of a scientific statement being exaggerated as an outcome of the rising problem of media manipulation. Given a pair of statements (say one from the source journal article and the other from the news article covering the results published in the journal), is it possible to ascertain with some confidence whether one is an exaggerated version of the other? This paper presents a surprisingly simple yet rational three-step approach that performs best for this task. We solve the task by breaking it into three sub-tasks as follows – (a) given a statement from a scientific paper or press release, we first extract relation phrases (e.g., ‘causes’ versus ‘might be correlated to’) connecting the dependent (e.g., ‘cancer’) and the independent (‘wine’) variable, (b) classify the strength of the relationship phrase extracted and (c) compare the strengths of the relation phrases extracted from the statements to identify whether one statement contains an exaggerated version of the other, and to what extent. Through rigorous experiments, we demonstrate that our simple approach by far outperforms baseline models that compare state-of-the-art embedding of the statement pairs through a binary classifier or recast the problem as a textual entailment task, which appears to be a very natural choice in this settings.
Keywords
Full Content
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics, pages 369–380 April 19 - 23, 2021. ©2021 Association for Computational Linguistics 369 Exploiting Emojis for Abusive Language Detection Michael Wiegand Digital Age Research Center (D!ARC) Alpen-Adria-Universit¨at Klagenfurt AT-9020 Klagenfurt, Austria michael.wiegand@aau.at Josef Ruppenhofer Leibniz Institute for German Language D-68161 Mannheim, Germany ruppenhofer@ids-mannheim.de Abstract We propose to use abusive emojis, such as the middle finger or face vomiting, as a proxy for learning a lexicon of abusive words. Since it represents extralinguistic information, a sin- gle emoji can co-occur with different forms of explicitly abusive utterances. We show that our approach generates a lexicon that offers the same performance in cross-domain classi- fication of abusive microposts as the most ad- vanced lexicon induction method. Such an ap- proach, in contrast, is dependent on manually annotated seed words and expensive lexical re- sources for bootstrapping (e.g. WordNet). We demonstrate that the same emojis can also be effectively used in languages other than En- glish. Finally, we also show that emojis can be exploited for classifying mentions of ambigu- ous words, such as fuck and bitch, into gener- ally abusive and just profane usages. 1 Introduction Abusive or offensive language is defined as hurt- ful, derogatory or obscene utterances made by one person to another.1 In the literature, closely re- lated terms include hate speech (Waseem and Hovy, 2016) or cyber bullying (Zhong et al., 2016). While there may be nuanced differences in meaning, they are all compatible with the general definition above. Due to the rise of user-generated web content, the amount of abusive language is also steadily growing. NLP methods are required to focus hu- man review efforts towards the most relevant mi- croposts. Building classifiers for abusive language detection requires expensive manually labeled data. In this paper we explore distant supervision (Mintz et al., 2009) for abusive language detec- tion in which abusive emojis serve as a heuristic to identify abusive language (1)-(8). These texts are subsequently used as training data. The advantage 1http://thelawdictionary.org of emojis is that some of them are unambiguously abusive. They are also often redundant (Donato and Paggio, 2017), i.e. they convey something already expressed verbally in the micropost. Since the con- cept conveyed by an emoji can be expressived ver- bally in many different ways, abusive emojis may co-occur with many different abusive words (e.g. idiot, cunt). Moreover, the meaning of emojis is (mostly) shared across languages. (1) You are such a hypocrite ... Have your dinner dick (2) @USER @USER you need a good old fashion man sized ass kicking you little Twitt (3) @USER I challenge you to go on a diet you fat cunt (4) @USER You are so so stupid you monkey face (5) Send your location, I’ll send some killers (6) @USER @USER A vote for toddstone or any liberal. Id rather flush a toilet. (7) Fuck the 12 fuck the cops we aint forgot about you, kill em all kill em all (8) …
Content truncated to 500 words
Labeled Text
AbstractThere is a huge difference between a scientific journal reporting ‘wine consumption might be correlated to cancer’, and a media outlet publishing ‘wine causes cancer’ citing the journal’s results. The above example is a typical case of a scientific statement being exaggerated as an outcome of the rising problem of media manipulation. Given a pair of statements (say one from the source journal article and the other from the news article covering the results published in the journal), is it possible to ascertain with some confidence whether one is an exaggerated version of the other? This paper presents a surprisingly simple yet rational three-step approach that performs best for this task. We solve the task by breaking it into three sub-tasks as follows – (a) given a statement from a scientific paper or press release, we first extract relation phrases (e.g., ‘causes’ versus ‘might be correlated to’) connecting the dependent (e.g., ‘cancer’) and the independent (‘wine’) variable, (b) classify the strength of the relationship phrase extracted and (c) compare the strengths of the relation phrases extracted from the statements to identify whether one statement contains an exaggerated version of the other, and to what extent. Through rigorous experiments, we demonstrate that our simple approach by far outperforms baseline models that compare state-of-the-art embedding of the statement pairs through a binary classifier or recast the problem as a textual entailment task, which appears to be a very natural choice in this settings.
Publication Details
- Paper ID:
- 42528
- Year:
- 2021
- Publication:
- TIPSTER
- Publication Type:
- conf
- DOI:
- nan