Предварительное обучение языку зрения
Related Papers
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning
AbstractVision-language pre-training (VLP) on large-scale image-text pairs has achieved huge success for the cross-modal downstream tasks. The most existing pre-training methods mainly adopt a two-step training procedure, which firstly employs …...
Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation
AbstractThe recent large-scale vision-language pre-training (VLP) of dual-stream architectures (e.g., CLIP) with a tremendous amount of image-text pair data, has shown its superiority on various multimodal alignment tasks. Despite its …...
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models
AbstractVision-language pre-training (VLP) has shown impressive performance on a wide range of cross-modal tasks, where VLP models without reliance on object detectors are becoming the mainstream due to their superior …...
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning
AbstractVision-Language Pre-training (VLP) has achieved impressive performance on various cross-modal downstream tasks. However, most existing methods can only learn from aligned image-caption data and rely heavily on expensive regional features, …...
Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis
AbstractAs an important task in sentiment analysis, Multimodal Aspect-Based Sentiment Analysis (MABSA) has attracted increasing attention inrecent years. However, previous approaches either (i) use separately pre-trained visual and textual models, …...