Көп деңгейлі көптілді білімді айдау

method ID: multilevelmultilingualknowledgedistillation

Related Papers

Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractPre-trained multilingual language models play an important role in cross-lingual natural language understanding tasks. However, existing methods did not focus on learning the semantic structure of representation, and thus could …...

31226