Distilling Pretrained Language Models
method
ID: distillingpretrainedlanguagemodels
Entity Details
Basic Information
Entity ID
distillingpretrainedlanguagemodels
Entity Type
Method
English Label
Distilling Pretrained Language Models
Russian Label
Дистилляция предварительно обученных языковых моделей
Kazakh Label
Алдын ала оқытылған тіл модельдерін айдау
Frequency
1
Description
English Description
A process of transferring knowledge from pretrained language models to improve student models.
Russian Description
-
Kazakh Description
-