Малые предварительно обученные языковые модели
material
ID: smallpretrainedlanguagemodels
Related Papers
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization
AbstractBy scaling the model size, large pre-trained language models (PLMs) have shown remarkable performance in various natural language processing tasks, mostly outperforming small PLMs by a large margin. However, due …...