Белгісіздікті бағалау
Related Papers
Word-Level Uncertainty Estimation for Black-Box Text Classifiers using RNNs
AbstractEstimating uncertainties of Neural Network predictions paves the way towards more reliable and trustful text classifications. However, common uncertainty estimation approaches remain as black-boxes without explaining which features have led …...
Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty Estimation
AbstractRecent multilingual pre-trained language models have achieved remarkable zero-shot performance, where the model is only finetuned on one source language and directly evaluated on target languages. In this work, we …...
On the Calibration and Uncertainty of Neural Learning to Rank Models for Conversational Search
AbstractAccording to the Probability Ranking Principle (PRP), ranking documents in decreasing order of their probability of relevance leads to an optimal document ranking for ad-hoc retrieval. The PRP holds when …...
Uncertainty Estimation and Reduction of Pre-trained Models for Text Regression
AbstractState-of-the-art classification and regression models are often not well calibrated, and cannot reliably provide uncertainty estimates, limiting their utility in safety-critical applications such as clinical decision-making. While recent work has …...
Uncertainty Estimation of Transformer Predictions for Misclassification Detection
AbstractUncertainty estimation (UE) of model predictions is a crucial step for a variety of tasks such as active learning, misclassification detection, adversarial attack detection, out-of-distribution detection, etc. Most of the …...
Hybrid Uncertainty Quantification for Selective Text Classification in Ambiguous Tasks
AbstractMany text classification tasks are inherently ambiguous, which results in automatic systems having a high risk of making mistakes, in spite of using advanced machine learning models. For example, toxicity …...
Test-time Adaptation for Machine Translation Evaluation by Uncertainty Minimization
AbstractThe neural metrics recently received considerable attention from the research community in the automatic evaluation of machine translation. Unlike text-based metrics that have interpretable and consistent evaluation mechanisms for various …...
Uncertainty Guided Label Denoising for Document-level Distant Relation Extraction
AbstractDocument-level relation extraction (DocRE) aims to infer complex semantic relations among entities in a document. Distant supervision (DS) is able to generate massive auto-labeled data, which can improve DocRE performance. …...