method ID: l2regularization

Related Papers

A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing

Authors: nan

Publication: TIPSTER (2007)

DOI: nan

This paper presents a comparative study of five parameter estimation algorithms on four NLP tasks. Three of the five algorithms are well-known in the computational linguistics community: Maximum Entropy (ME) …...

36594

L1 Regularized Regression for Reranking and System Combination in Machine Translation

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

We use L1 regularized transductive regres- sion to learn mappings between source and target features of the training sets derived for each test sentence and use these mappings to rerank …...

28298

Regularization techniques for fine-tuning in neural machine translation

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractWe investigate techniques for supervised domain adaptation for neural machine translation where an existing model trained on a large out-of-domain dataset is adapted to a small in-domain dataset. In this …...

32905

Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractAlthough teacher forcing has become the main training paradigm for neural machine translation, it usually makes predictions only conditioned on past information, and hence lacks global planning for the future. …...

8661

Sequence Length is a Domain: Length-based Overfitting in Transformer Models

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractTransformer-based sequence-to-sequence architectures, while achieving state-of-the-art results on a large number of NLP tasks, can still suffer from overfitting during training. In practice, this is usually countered either by applying …...

31170