Building Evaluation Datasets for Cultural Microblog Retrieval

Building Evaluation Datasets for Cultural Microblog Retrieval Lorraine Goeuriot, Josiane Mothe, Philippe Mulhem, Eric SanJuan LIG, IRIT, LIA Univ. Grenoble Alpes, CNRS, Grenoble INP, France Universit´e de Toulouse, France Universit´e d’Avignon, France {lorraine.goeuriot,philippe.mulhem}@univ-grenoble-alpes.fr josiane.mothe@irit.fr, eric.sanjuan@univ-avignon.fr Abstract ECLEF Microblog Cultural Contextualization is an evaluation challenge aiming at providing the research community with datasets to gather, organize and deliver relevant social data related to events generating large number of microblogs and web documents. The evaluation challenges runs every year since 2016. We describe in this paper the resources built for the challenge, that can be used outside of the context of the challenge. Keywords: microblog search, social network moining, cultural data, evaluation, informativeness 1. Introduction Many statistic studies have shown the importance of social media; They seem to be now the main Internet activity for Americans, even when compared to email1, and most of the social media. Chinese users spend an average of almost 90 minutes per day on social networks2. Social media is thus a key media for any company or organization, specifically in Business Intelligence related activities. Companies use so- cial data to gather insights on customer satisfaction, but can also relate this data to forecast product or services revenues (Rui and Whinston, 2011) or measure and optimize their marketing. On the other hand, there are several levers that make social media such popular. In the context of Twitter, Liu et al. mention content gratification (“content of the in- formation carried through Twitter”) and technology gratifi- cation (“easy to use”) as the main gratifications influencing users’intention to continue to use Twitter; other gratifica- tions being process (“searching for something or to pass time”) and social (“interactivity with other parties through media”) gratifications (Liu et al., 2010). With regards to events such as festivals, social media is now widely used, and gathers various communities at cultural events: organizers, media, attendees, general public not at- tending the event. These communities are generally inter- ested in different aspects of the generated information: • the organizers: social media is a nice way to promote an event because it is community-driven. Social me- dia is also useful during the event to get feedback from attendees and because it allows short and timely up- dates. After the event, data analytics on the discussion is also a useful feedback ; 1http://www.socialmediatoday.com/ content/17-statistics-show-social- media-future-customer-service, //www.businessinsider.com/social-media-http: engagement-statistics-2013-12?IR=T 2http://www.setupablogtoday.com/chinese- social-media-statistics/ • the media: other media make use of the content put by organizers and attendees to report the event , as well as to inform the public; • the public attending a festival: social media is a mean to get information on the event, and communicate with other attendees on the vent it-self or related topics; • the public not attending a festival: to get attendees and media feedback about the event using social media . Social media is becoming a core component of communi- cation for any event, either professional or cultural. Mining and organizing the information surrounding a cul- tural event can help broadening the perception and visual- …

Content truncated to 500 words