BUCC
Related Papers
English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too
AbstractIntermediate-task training—fine-tuning a pretrained model on an intermediate task before fine-tuning again on the target task—often improves model performance substantially on language understanding tasks in monolingual English settings. We investigate …...
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast
AbstractIn this paper, we propose to align sentence representations from different languages into a unified embedding space, where semantic similarities (both cross-lingual and monolingual) can be computed with a simple …...
Cross-lingual Sentence Embedding using Multi-Task Learning
AbstractMultilingual sentence embeddings capture rich semantic information not only for measuring similarity between texts but also for catering to a broad range of downstream cross-lingual NLP tasks. State-of-the-art multilingual sentence …...
LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation
AbstractLarge-scale language-agnostic sentence embedding models such as LaBSE (Feng et al., 2022) obtain state-of-the-art performance for parallel sentence alignment. However, these large-scale models can suffer from inference speed and computation …...