Маскировка стратегиясы
Related Papers
Identifying Elements Essential for BERT’s Multilinguality
AbstractIt has been shown that multilingual BERT (mBERT) yields high quality multilingual representations and enables effective zero-shot transfer. This is surprising given that mBERT does not use any crosslingual signal …...
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change
AbstractRecent research has revealed that neural language models at scale suffer from poor temporal generalization capability, i.e., language model pre-trained on static data from past years performs worse over time …...
Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction
AbstractText error correction aims to correct the errors in text sequences such as those typed by humans or generated by speech recognition models. Previous error correction methods usually take the …...
DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation
AbstractEmpathy is a crucial factor in open-domain conversations, which naturally shows one’s caring and understanding to others. Though several methods have been proposed to generate empathetic responses, existing works often …...