Монте-Карло Dropout
Related Papers
Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates
AbstractAnnotating training data for sequence tagging of texts is usually very time-consuming. Recent advances in transfer learning for natural language processing in conjunction with active learning open the possibility to …...
How Certain is Your Transformer?
AbstractIn this work, we consider the problem of uncertainty estimation for Transformer-based models. We investigate the applicability of uncertainty estimates based on dropout usage at the inference stage (Monte Carlo …...
Disentangling Uncertainty in Machine Translation Evaluation
AbstractTrainable evaluation metrics for machine translation (MT) exhibit strong correlation with human judgements, but they are often hard to interpret and might produce unreliable scores under noisy or out-of-domain data. …...
Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning
AbstractWe introduce distributed NLI, a new NLU task with a goal to predict the distribution of human judgements for natural language inference. We show that by applying additional distribution estimation …...
Distribution Calibration for Out-of-Domain Detection with Bayesian Approximation
AbstractOut-of-Domain (OOD) detection is a key component in a task-oriented dialog system, which aims to identify whether a query falls outside the predefined supported intent set. Previous softmax-based detection algorithms …...
Welocalize-ARC/NKUA’s Submission to the WMT 2022 Quality Estimation Shared Task
AbstractThis paper presents our submission to the WMT 2022 quality estimation shared task and more specifically to the quality prediction sentence-level direct assessment (DA) subtask. We build a multilingual system …...