Aggression-annotated Corpus of Hindi-English Code-mixed Data

Aggression-annotated Corpus of Hindi-English Code-mixed Data Ritesh Kumar, Aishwarya N. Reganti, Akshit Bhatia, Tushar Maheshwari Dr. Bhim Rao Ambedkar University, Indian Institute of Information Technology-Sricity, Birla Institute of Technology and Science-Pilani, Indian Institute of Information Technology-Sricity Agra, Sricity, Pilani, Sricity riteshkrjnu@gmail.com, aishwarya.r14@iiits.in, akshit1811@gmail.com, tushar.m14@iiits.in Abstract As the interaction over the web has increased, incidents of aggression and related events like trolling, cyberbullying, flaming, hate speech, etc. too have increased manifold across the globe. While most of these behaviour like bullying or hate speech have predated the Internet, the reach and extent of the Internet has given these an unprecedented power and influence to affect the lives of billions of people. So it is of utmost significance and importance that some preventive measures be taken to provide safeguard to the people using the web such that the web remains a viable medium of communication and connection, in general. In this paper, we discuss the development of an aggression tagset and an annotated corpus of Hindi-English code-mixed data from two of the most popular social networking / social media platforms in India – Twitter and Facebook. The corpus is annotated using a hierarchical tagset of 3 top-level tags and 10 level 2 tags. The final dataset contains approximately 18k tweets and 21k facebook comments and is being released for further research in the field. Keywords: aggression, hate speech, trolling, Hindi-English, code-mixing, Facebook, Twitter 1. Introduction In the last few years, we have witnessed a gradual shift from largely static, read-only web to quickly expanding user-generated web. There has been an exponential growth in the availability and use of online platforms where users could put their own content. A major part of these platforms include social media websites, blogs, Q&A forums and several similar platforms. All of these are almost exclusively user-generated websites. As such they change and expand at a very rapid pace. In addition to this, most of the traditionally read-only web have started to give an option to the readers to interact with the website as well as the other users by posting their comments and replying to the comments of other users. In all of these platforms and forums, humongous amount of data is created and circulated every minute. It has been estimated that there has been an increase of approximately 25% in the number of tweets per minutes and 22% increase in the number of Facebook posts per minute in the last 3 years. It is posited that approximately 500 million tweets are sent per day, 4.3 billion Facebook messages are posted each day, more than 200 million emails are sent each day, and approximately 2 million new blog posts are created daily over the web (Schultz, 2016). We still do not have a consolidated figure on the number of comments and opinion generated on different websites but it can be safely assumed that those would be comparably staggering. As the number of people and this interaction over the web has increased, incidents of aggression and related events …

Content truncated to 500 words