Multimodal Sentiment Analysis
Related Papers
Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis
We present a novel way of extracting fea- tures from short texts, based on the acti- vation values of an inner layer of a deep convolutional neural network. We use …...
Tensor Fusion Network for Multimodal Sentiment Analysis
AbstractMultimodal sentiment analysis is an increasingly popular research area, which extends the conventional language-based definition of sentiment analysis to a multimodal setup where other relevant modalities accompany language. In this …...
Multimodal Sentiment Analysis with Multi-perspective Fusion Network Focusing on Sense Attentive Language
AbstractMultimodal sentiment analysis aims to learn a joint representation of multiple features. As demonstrated by previous studies, it is shown that the language modality may contain more semantic information than …...
SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment Analysis
AbstractMultimodal sentiment analysis aims to predict sentiment of language text with the help of other modalities, such as vision and acoustic features. Previous studies focused on learning the joint representation …...
CTFN: Hierarchical Learning for Multimodal Sentiment Analysis Using Coupled-Translation Fusion Network
AbstractMultimodal sentiment analysis is the challenging research area that attends to the fusion of multiple heterogeneous modalities. The main challenge is the occurrence of some missing modalities during the multimodal …...
Improving Multimodal fusion via Mutual Dependency Maximisation
AbstractMultimodal sentiment analysis is a trending area of research, and multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, …...
Curriculum Learning Meets Weakly Supervised Multimodal Correlation Learning
AbstractIn the field of multimodal sentiment analysis (MSA), a few studies have leveraged the inherent modality correlation information stored in samples for self-supervised learning. However, they feed the training pairs …...
Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities
AbstractFor the missing modality problem in Multimodal Sentiment Analysis (MSA), the inconsistency phenomenon occurs when the sentiment changes due to the absence of a modality. The absent modality that determines …...
Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis
AbstractThe existing research efforts in Multimodal Sentiment Analysis (MSA) have focused on developing the expressive ability of neural networks to fuse information from different modalities. However, these approaches lack a …...
Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors
AbstractMultimodal sentiment analysis has attracted increasing attention and lots of models have been proposed. However, the performance of the state-of-the-art models decreases sharply when they are deployed in the real …...
Towards Exploiting Sticker for Multimodal Sentiment Analysis in Social Media: A New Dataset and Baseline
AbstractSentiment analysis in social media is challenging since posts are short of context. As a popular way to express emotion on social media, stickers related to these posts can supplement …...
ConFEDE: Contrastive Feature Decomposition for Multimodal Sentiment Analysis
AbstractMultimodal Sentiment Analysis aims to predict the sentiment of video content. Recent research suggests that multimodal sentiment analysis critically depends on learning a good representation of multimodal information, which should …...
Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis
AbstractWhile multimodal sentiment analysis (MSA) has gained much attention over the last few years, the main focus of most work on MSA has been limited to constructing multimodal representations that …...