Мультимодальная задача
Related Papers
Detecting Propaganda Techniques in Memes
AbstractPropaganda can be defined as a form of communication that aims to influence the opinions or the actions of people towards a specific goal; this is achieved by means of …...
CoSIm: Commonsense Reasoning for Counterfactual Scene Imagination
AbstractAs humans, we can modify our assumptions about a scene by imagining alternative objects or concepts in our minds. For example, we can easily anticipate the implications of the sun …...
Do Vision-and-Language Transformers Learn Grounded Predicate-Noun Dependencies?
AbstractRecent advances in vision-and-language modeling have seen the development of Transformer architectures that achieve remarkable performance on multimodal reasoning tasks. Yet, the exact capabilities of these black-box models are still …...
MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences
AbstractExisting multimodal tasks mostly target at the complete input modality setting, i.e., each modality is either complete or completely missing in both training and test sets. However, the randomly missing …...