Условная маскированная языковая модель
Related Papers
Incorporating a Local Translation Mechanism into Non-autoregressive Translation
AbstractIn this work, we introduce a novel local autoregressive translation (LAT) mechanism into non-autoregressive translation (NAT) models so as to capture local dependencies among target outputs. Specifically, for each target …...
Inference Strategies for Machine Translation with Conditional Masking
AbstractConditional masked language model (CMLM) training has proven successful for non-autoregressive and semi-autoregressive sequence generation tasks, such as machine translation. Given a trained CMLM, however, it is not clear what …...
MR-P: A Parallel Decoding Algorithm for Iterative Refinement Non-Autoregressive Translation
AbstractNon-autoregressive translation (NAT) predicts all the target tokens in parallel and significantly speeds up the inference process. The Conditional Masked Language Model (CMLM) is a strong baseline of NAT. It …...
NJUNLP’s Participation for the WMT2022 Quality Estimation Shared Task
AbstractThis paper presents submissions of the NJUNLP team in WMT 2022Quality Estimation shared task 1, where the goal is to predict the sentence-level and word-level quality for target machine translations. …...
Semantically Consistent Data Augmentation for Neural Machine Translation via Conditional Masked Language Model
AbstractThis paper introduces a new data augmentation method for neural machine translation that can enforce stronger semantic consistency both within and across languages. Our method is based on Conditional Masked …...