Переобучение
otherentity
ID: overparameterization
Related Papers
A Primer in BERTology: What We Know About How BERT Works
AbstractTransformer-based models have pushed state of the art in many areas of NLP, but our understanding of what is behind their success is still limited. This paper is the first …...
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization
AbstractBy scaling the model size, large pre-trained language models (PLMs) have shown remarkable performance in various natural language processing tasks, mostly outperforming small PLMs by a large margin. However, due …...