Бірмодальды модельдер
Related Papers
Crisscrossed Captions: Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
AbstractBy supporting multi-modal retrieval training and evaluation, image captioning datasets have spurred remarkable progress on representation learning. Unfortunately, datasets have limited cross-modal associations: images are not paired with other images, …...
Detecting Harmful Memes and Their Targets
Among the various modes of communication in social media, the use of Internet memes has emerged as a powerful means to convey politi- cal, psychological, and socio-cultural opinions. Although memes …...
FigMemes: A Dataset for Figurative Language Identification in Politically-Opinionated Memes
AbstractReal-world politically-opinionated memes often rely on figurative language to cloak propaganda and radical ideas to help them spread. It is not only a scientific challenge to develop machine learning models …...
IIITH at SemEval-2022 Task 5: A comparative study of deep learning models for identifying misogynous memes
AbstractThis paper provides a comparison of different deep learning methods for identifying misogynous memes for SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification. In this task, we experiment with architectures in …...
Modality-specific Learning Rates for Effective Multimodal Additive Late-fusion
AbstractIn multimodal machine learning, additive late-fusion is a straightforward approach to combine the feature representations from different modalities, in which the final prediction can be formulated as the sum of …...
Characterizing the Entities in Harmful Memes: Who is the Hero, the Villain, the Victim?
AbstractMemes can sway people’s opinions over social media as they combine visual and textual information in an easy-to-consume manner. Since memes instantly turn viral, it becomes crucial to infer their …...