Static Strategies
method
ID: staticstrategies
Related Papers
Uncertainty-Aware Balancing for Multilingual and Multi-Domain Neural Machine Translation Training
AbstractLearning multilingual and multi-domain translation model is challenging as the heterogeneous and imbalanced data make the model converge inconsistently over different corpora in real world. One common practice is to …...
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization
AbstractBy scaling the model size, large pre-trained language models (PLMs) have shown remarkable performance in various natural language processing tasks, mostly outperforming small PLMs by a large margin. However, due …...