Көміртек Ізі
otherentity
ID: carbonfootprint
Related Papers
Energy and Policy Considerations for Deep Learning in NLP
AbstractRecent progress in hardware and methodology for training neural networks has ushered in a new generation of large networks trained on abundant data. These models have obtained notable gains in …...
Efficiently Reusing Old Models Across Languages via Transfer Learning
AbstractRecent progress in neural machine translation (NMT) is directed towards larger neural networks trained on an increasing amount of hardware resources. As a result, NMT models are costly to train, …...
Multiple Teacher Distillation for Robust and Greener Models
AbstractThe language models nowadays are in the center of natural language processing progress. These models are mostly of significant size. There are successful attempts to reduce them, but at least …...