Multimodal Named Entity Recognition
Related Papers
Multimodal Named Entity Recognition for Short Social Media Posts
AbstractWe introduce a new task called Multimodal Named Entity Recognition (MNER) for noisy user-generated data such as tweets or Snapchat captions, which comprise short text with accompanying images. These social …...
Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal Transformer
AbstractIn this paper, we study Multimodal Named Entity Recognition (MNER) for social media posts. Existing approaches for MNER mainly suffer from two drawbacks: (1) despite generating word-aware visual representations, their …...
RIVA: A Pre-trained Tweet Multimodal Model Based on Text-image Relation for Multimodal NER
AbstractMultimodal named entity recognition (MNER) for tweets has received increasing attention recently. Most of the multimodal methods used attention mechanisms to capture the text-related visual information. However, unrelated or weakly …...
A Span-based Multimodal Variational Autoencoder for Semi-supervised Multimodal Named Entity Recognition
AbstractMultimodal named entity recognition (MNER) on social media is a challenging task which aims to extract named entities in free text and incorporate images to classify them into user-defined types. …...
Flat Multi-modal Interaction Transformer for Named Entity Recognition
AbstractMulti-modal named entity recognition (MNER) aims at identifying entity spans and recognizing their categories in social media posts with the aid of images. However, in dominant MNER approaches, the interaction …...
ITA: Image-Text Alignments for Multi-Modal Named Entity Recognition
AbstractRecently, Multi-modal Named Entity Recognition (MNER) has attracted a lot of attention. Most of the work utilizes image information through region-level visual representations obtained from a pretrained object detector and …...
Grounded Multimodal Named Entity Recognition on Social Media
AbstractIn recent years, Multimodal Named Entity Recognition (MNER) on social media has attracted considerable attention. However, existing MNER studies only extract entity-type pairs in text, which is useless for multimodal …...
P-MNER: Cross Modal Correction Fusion Network with Prompt Learning for Multimodal Named Entity Recognitiong
Abstract“Multimodal Named Entity Recognition (MNER) is a challenging task in social mediadue to the combination of text and image features. Previous MNER work has focused onpredicting entity information after fusing …...