Минималды тәуекелмен оқыту
Related Papers
A Unified Approach to Minimum Risk Training and Decoding
We present a unified approach to perform- ing minimum risk training and minimum Bayes risk (MBR) decoding with BLEU in a phrase-based model. Key to our ap- proach is the …...
Minimum-Risk Training of Approximate CRF-Based NLP Systems
Conditional Random Fields (CRFs) are a pop- ular formalism for structured prediction in NLP. It is well known how to train CRFs with certain topologies that admit exact inference, such …...
Minimum Risk Training for Neural Machine Translation
We propose minimum risk training for end-to-end neural machine translation. Unlike conventional maximum likelihood estimation, minimum risk training is ca- pable of optimizing model parameters di- rectly with respect to …...
Neural Transition-based String Transduction for Limited-Resource Setting in Morphology
AbstractWe present a neural transition-based model that uses a simple set of edit actions (copy, delete, insert) for morphological transduction tasks such as inflection generation, lemmatization, and reinflection. In a …...
Global Optimization under Length Constraint for Neural Text Summarization
AbstractWe propose a global optimization method under length constraint (GOLC) for neural text summarization models. GOLC increases the probabilities of generating summaries that have high evaluation scores, ROUGE in this …...
Learning Neural Sequence-to-Sequence Models from Weak Feedback with Bipolar Ramp Loss
AbstractIn many machine learning scenarios, supervision by gold labels is not available and conse quently neural models cannot be trained directly by maximum likelihood estimation. In a weak supervision scenario, …...
Towards Explainable NLP: A Generative Explanation Framework for Text Classification
AbstractBuilding explainable systems is a critical problem in the field of Natural Language Processing (NLP), since most machine learning models provide no explanations for the predictions. Existing approaches for explainable …...
Addressing Exposure Bias With Document Minimum Risk Training: Cambridge at the WMT20 Biomedical Translation Task
AbstractThe 2020 WMT Biomedical translation task evaluated Medline abstract translations. This is a small-domain translation task, meaning limited relevant training data with very distinct style and vocabulary. Models trained on …...
On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation
AbstractThe standard training algorithm in neural machine translation (NMT) suffers from exposure bias, and alternative algorithms have been proposed to mitigate this. However, the practical impact of exposure bias is …...
Using Context in Neural Machine Translation Training Objectives
AbstractWe present Neural Machine Translation (NMT) training using document-level metrics with batch-level documents. Previous sequence-objective approaches to NMT training focus exclusively on sentence-level metrics like sentence BLEU which do not …...
Risk Minimization for Zero-shot Sequence Labeling
AbstractZero-shot sequence labeling aims to build a sequence labeler without human-annotated datasets. One straightforward approach is utilizing existing systems (source models) to generate pseudo-labeled datasets and train a target sequence …...
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training
AbstractAutomatic metrics play a crucial role in machine translation. Despite the widespread use of n-gram-based metrics, there has been a recent surge in the development of pre-trained model-based metrics that …...