Visual Modality
Related Papers
Visual Information in Semantic Representation
The question of how meaning might be ac- quired by young children and represented by adult speakers of a language is one of the most debated topics in cognitive science. …...
WAPUSK20 - A Database for Robust Audiovisual Speech Recognition
AbstractAudiovisual speech recognition (AVSR) systems have been proven superior over audio-only speech recognizers in noisy environments by incorporating features of the visual modality. In order to develop reliable AVSR systems, …...
Utterance-Level Multimodal Sentiment Analysis
During real-life interactions, people are naturally gesturing and modulating their voice to emphasize specific points or to express their emotions. With the recent growth of social websites such as YouTube, …...
Probing the Need for Visual Context in Multimodal Machine Translation
AbstractCurrent work on multimodal machine translation (MMT) has suggested that the visual modality is either unnecessary or only marginally beneficial. We posit that this is a consequence of the very …...
Double Attention-based Multimodal Neural Machine Translation with Semantic Image Regions
AbstractExisting studies on multimodal neural machine translation (MNMT) have mainly focused on the effect of combining visual and textual modalities to improve translations. However, it has been suggested that the …...