Оптимизаторы
otherentity
ID: optimizers
Related Papers
The Sockeye Neural Machine Translation Toolkit at AMTA 2018
We describe SOCKEYE,1 an open-source sequence-to-sequence toolkit for Neural Machine Translation (NMT). SOCKEYE is a production-ready framework for training and applying models as well as an experimental platform for researchers. …...
Understanding the Difficulty of Training Transformers
AbstractTransformers have proved effective in many NLP tasks. However, their training requires non-trivial efforts regarding carefully designing cutting-edge optimizers and learning rate schedulers (e.g., conventional SGD fails to train Transformers …...