Multimodal Approach
Related Papers
I Can Has Cheezburger? A Nonparanormal Approach to Combining Textual and Visual Information for Predicting and Generating Popular Meme Descriptions
The advent of social media has brought Inter- net memes, a unique social phenomenon, to the front stage of the Web. Embodied in the form of images with text descriptions, …...
Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos
AbstractEmotion recognition in conversations is crucial for the development of empathetic machines. Present methods mostly ignore the role of inter-speaker dependency relations while classifying emotions in conversations. In this paper, …...
Inferring Social Media Users’ Mental Health Status from Multimodal Information
AbstractWorldwide, an increasing number of people are suffering from mental health disorders such as depression and anxiety. In the United States alone, one in every four adults suffers from a …...
MultiQT: Multimodal learning for real-time question tracking in speech
AbstractWe address a challenging and practical task of labeling questions in speech in real time during telephone calls to emergency medical services in English, which embeds within a broader decision …...
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation
AbstractThis paper addresses the problem of simultaneous machine translation (SiMT) by exploring two main concepts: (a) adaptive policies to learn a good trade-off between high translation quality and low latency; …...
Leveraging Hashtag Networks for Multimodal Popularity Prediction of Instagram Posts
AbstractWith the increasing commercial and social importance of Instagram in recent years, more researchers begin to take multimodal approaches to predict popular content on Instagram. However, existing popularity prediction approaches …...