Алдын ала үйретілген көптілді тілдік модельдер

AbstractPre-trained multilingual language models, e.g., multilingual-BERT, are widely used in cross-lingual tasks, yielding the state-of-the-art performance. However, such models suffer from a large performance gap between source and target languages, …...