Көпмодальды терең оқыту
Related Papers
Hybrid Attention based Multimodal Network for Spoken Language Classification
AbstractWe examine the utility of linguistic content and vocal characteristics for multimodal deep learning in human spoken language understanding. We present a deep multimodal network with both feature attention and …...
R2D2 at SemEval-2022 Task 5: Attention is only as good as its Values! A multimodal system for identifying misogynist memes
AbstractThis paper describes the multimodal deep learning system proposed for SemEval 2022 Task 5: MAMI - Multimedia Automatic Misogyny Identification. We participated in both Subtasks, i.e. Subtask A: Misogynous meme …...
taochen at SemEval-2022 Task 5: Multimodal Multitask Learning and Ensemble Learning
AbstractWe present a multi-modal deep learning system for the Multimedia Automatic Misogyny Identification (MAMI) challenge, a SemEval task of identifying and classifying misogynistic messages in online memes. We adapt multi-task …...
Cross-Modal Attribute Insertions for Assessing the Robustness of Vision-and-Language Learning
AbstractThe robustness of multimodal deep learning models to realistic changes in the input text is critical for applicability on important tasks such as text-to-image retrieval and cross-modal entailment. To measure …...