Көп деңгейлі көптілді білімді айдау
method
ID: multilevelmultilingualknowledgedistillation
Related Papers
Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model
AbstractPre-trained multilingual language models play an important role in cross-lingual natural language understanding tasks. However, existing methods did not focus on learning the semantic structure of representation, and thus could …...