Извлечение текста из изображений
Related Papers
LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval
AbstractMultimodal pre-training has propelled great advancement in vision-and-language research. These large-scale pre-trained models, although successful, fatefully suffer from slow inference speed due to enormous computational cost mainly from cross-modal attention …...
CPL: Counterfactual Prompt Learning for Vision and Language Models
AbstractPrompt tuning is a new few-shot transfer learning technique that only tunes the learnable prompt for pre-trained vision and language models such as CLIP. However, existing prompt tuning methods tend …...
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
AbstractLarge-scale pre-trained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstream tasks. This paper presents …...
PoliTo at SemEval-2023 Task 1: CLIP-based Visual-Word Sense Disambiguation Based on Back-Translation
AbstractVisual-Word Sense Disambiguation (V-WSD) entails resolving the linguistic ambiguity in a text by selecting a clarifying image from a set of (potentially misleading) candidates. In this paper, we address V-WSD …...