Кросс-лингвистикалық алдын ала оқыту
Related Papers
Cross-lingual Cross-modal Pretraining for Multimodal Retrieval
AbstractRecent pretrained vision-language models have achieved impressive performance on cross-modal retrieval tasks in English. Their success, however, heavily depends on the availability of many annotated image-caption datasets for pretraining, where …...
Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation
AbstractSuccessful methods for unsupervised neural machine translation (UNMT) employ cross-lingual pretraining via self-supervision, often in the form of a masked language modeling or a sequence generation task, which requires the …...
Multi-Granularity Contrasting for Cross-Lingual Pre-Training
Cross-lingual pre-training aims at providing effective prior representations for the inputs from multiple languages. With the model- ing of bidirectional contexts, recently preva- lent language modeling approaches such as XLM …...
XLPT-AMR: Cross-Lingual Pre-Training via Multi-Task Learning for Zero-Shot AMR Parsing and Text Generation
AbstractDue to the scarcity of annotated data, Abstract Meaning Representation (AMR) research is relatively limited and challenging for languages other than English. Upon the availability of English AMR dataset and …...