Out of Domain Data
Related Papers
Analysing the Effect of Out-of-Domain Data on SMT Systems
In statistical machine translation (SMT), it is known that performance declines when the training data is in a different domain from the test data. Nevertheless, it is frequently nec- essary …...
Nightmare at test time: How punctuation prevents parsers from generalizing
AbstractPunctuation is a strong indicator of syntactic structure, and parsers trained on text with punctuation often rely heavily on this signal. Punctuation is a diversion, however, since human language processing …...
Exploiting Out-of-Domain Parallel Data through Multilingual Transfer Learning for Low-Resource Neural Machine Translation
This paper proposes a novel multilin- gual multistage fine-tuning approach for low-resource neural machine translation (NMT), taking a challenging Japanese– Russian pair for benchmarking. Al- though there are many solutions …...
Event-Related Bias Removal for Real-time Disaster Events
AbstractSocial media has become an important tool to share information about crisis events such as natural disasters and mass attacks. Detecting actionable posts that contain useful information requires rapid analysis …...
Selective Question Answering under Domain Shift
AbstractTo avoid giving wrong answers, question answering (QA) models need to know when to abstain from answering. Moreover, users often ask questions that diverge from the model’s training data, making …...
IST-Unbabel 2021 Submission for the Quality Estimation Shared Task
AbstractWe present the joint contribution of IST and Unbabel to the WMT 2021 Shared Task on Quality Estimation. Our team participated on two tasks: Direct Assessment and Post-Editing Effort, encompassing …...
Informal Persian Universal Dependency Treebank
AbstractThis paper presents the phonological, morphological, and syntactic distinctions between formal and informal Persian, showing that these two variants have fundamental differences that cannot be attributed solely to pronunciation discrepancies. …...
Learning Confidence for Transformer-based Neural Machine Translation
AbstractConfidence estimation aims to quantify the confidence of the model prediction, providing an expectation of success. A well-calibrated confidence estimate enables accurate failure prediction and proper risk measurement when given …...
Named Entity Recognition in a Very Homogenous Domain
AbstractMachine Learning models have lower accuracy when tested on out-of-domain data. Developing models that perform well on several domains or can be quickly adapted to a new domain is an …...