Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers

26870

Knowledge Triples

Source Entity	Relationship	Target Entity
Multimodal Transformer Models Method	appliesTo	Zero-Shot Image Retrieval Task
Pretraining Data Material	relatedTo	Dataset Noise Metric
Pretraining Data Material	relatedTo	Language Similarity OtherEntity
Zero-Shot Image Retrieval Task	impacts	Attention Mechanism Method
Zero-Shot Image Retrieval Task	impacts	Loss Functions Method
Zero-Shot Image Retrieval Task	impacts	Pretraining Data Material