XLM-E

Вернуться к списку
method ID: xlme

Related Papers

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn this paper, we introduce ELECTRA-style tasks to cross-lingual language model pre-training. Specifically, we present two pre-training tasks, namely multilingual replaced token detection, and translation replaced token detection. Besides, we …...

38961