Multimodal Sentiment Analysis

task ID: multimodalsentimentanalysis

Related Papers

Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

We present a novel way of extracting fea- tures from short texts, based on the acti- vation values of an inner layer of a deep convolutional neural network. We use …...

34223

Tensor Fusion Network for Multimodal Sentiment Analysis

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractMultimodal sentiment analysis is an increasingly popular research area, which extends the conventional language-based definition of sentiment analysis to a multimodal setup where other relevant modalities accompany language. In this …...

33005

Multimodal Sentiment Analysis with Multi-perspective Fusion Network Focusing on Sense Attentive Language

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractMultimodal sentiment analysis aims to learn a joint representation of multiple features. As demonstrated by previous studies, it is shown that the language modality may contain more semantic information than …...

5594

SWAFN: Sentimental Words Aware Fusion Network for Multimodal Sentiment Analysis

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractMultimodal sentiment analysis aims to predict sentiment of language text with the help of other modalities, such as vision and acoustic features. Previous studies focused on learning the joint representation …...

4263

CTFN: Hierarchical Learning for Multimodal Sentiment Analysis Using Coupled-Translation Fusion Network

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractMultimodal sentiment analysis is the challenging research area that attends to the fusion of multiple heterogeneous modalities. The main challenge is the occurrence of some missing modalities during the multimodal …...

8284

Improving Multimodal fusion via Mutual Dependency Maximisation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractMultimodal sentiment analysis is a trending area of research, and multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, …...

32080

Curriculum Learning Meets Weakly Supervised Multimodal Correlation Learning

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn the field of multimodal sentiment analysis (MSA), a few studies have leveraged the inherent modality correlation information stored in samples for self-supervised learning. However, they feed the training pairs …...

31219

Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractFor the missing modality problem in Multimodal Sentiment Analysis (MSA), the inconsistency phenomenon occurs when the sentiment changes due to the absence of a modality. The absent modality that determines …...

31309

Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThe existing research efforts in Multimodal Sentiment Analysis (MSA) have focused on developing the expressive ability of neural networks to fuse information from different modalities. However, these approaches lack a …...

3658

Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractMultimodal sentiment analysis has attracted increasing attention and lots of models have been proposed. However, the performance of the state-of-the-art models decreases sharply when they are deployed in the real …...

32801

Towards Exploiting Sticker for Multimodal Sentiment Analysis in Social Media: A New Dataset and Baseline

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractSentiment analysis in social media is challenging since posts are short of context. As a popular way to express emotion on social media, stickers related to these posts can supplement …...

4632

ConFEDE: Contrastive Feature Decomposition for Multimodal Sentiment Analysis

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractMultimodal Sentiment Analysis aims to predict the sentiment of video content. Recent research suggests that multimodal sentiment analysis critically depends on learning a good representation of multimodal information, which should …...

38442

Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractWhile multimodal sentiment analysis (MSA) has gained much attention over the last few years, the main focus of most work on MSA has been limited to constructing multimodal representations that …...

33446