Компактные языковые модели
method
ID: compactlanguagemodels
Related Papers
On the importance of pre-training data volume for compact language models
AbstractRecent advances in language modeling have led to computationally intensive and resource-demanding state-of-the-art models. In an effort towards sustainable practices, we study the impact of pre-training data volume on compact …...