L2 реттеу
Related Papers
A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing
This paper presents a comparative study of five parameter estimation algorithms on four NLP tasks. Three of the five algorithms are well-known in the computational linguistics community: Maximum Entropy (ME) …...
L1 Regularized Regression for Reranking and System Combination in Machine Translation
We use L1 regularized transductive regres- sion to learn mappings between source and target features of the training sets derived for each test sentence and use these mappings to rerank …...
Regularization techniques for fine-tuning in neural machine translation
AbstractWe investigate techniques for supervised domain adaptation for neural machine translation where an existing model trained on a large out-of-domain dataset is adapted to a small in-domain dataset. In this …...
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation
AbstractAlthough teacher forcing has become the main training paradigm for neural machine translation, it usually makes predictions only conditioned on past information, and hence lacks global planning for the future. …...
Sequence Length is a Domain: Length-based Overfitting in Transformer Models
AbstractTransformer-based sequence-to-sequence architectures, while achieving state-of-the-art results on a large number of NLP tasks, can still suffer from overfitting during training. In practice, this is usually countered either by applying …...