method ID: uniter

Related Papers

What Does BERT with Vision Look At?

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractPre-trained visually grounded language models such as ViLBERT, LXMERT, and UNITER have achieved significant performance improvement on vision-and-language tasks but what they learn during pre-training remains unclear. In this work, …...

37499

UPB at SemEval-2022 Task 5: Enhancing UNITER with Image Sentiment and Graph Convolutional Networks for Multimedia Automatic Misogyny Identification

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn recent times, the detection of hate-speech, offensive, or abusive language in online media has become an important topic in NLP research due to the exponential growth of social media …...

25088

Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractDespite recent progress towards scaling up multimodal vision-language models, these models are still known to struggle on compositional generalization benchmarks such as Winoground. We find that a critical component lacking …...

38562