Монолингвальный BERT
Related Papers
Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher
AbstractCross-lingual text classification alleviates the need for manually labeled documents in a target language by leveraging labeled documents from other languages. Existing approaches for transferring supervision across languages require expensive …...
Mitigating Language-Dependent Ethnic Bias in BERT
AbstractIn this paper, we study ethnic bias and how it varies across languages by analyzing and mitigating ethnic bias in monolingual BERT for English, German, Spanish, Korean, Turkish, and Chinese. …...
Monolingual versus multilingual BERTology for Vietnamese extractive multi-document summarization
Recent researches have demonstrated that BERT shows potential in a wide range of natural language processing tasks. is adopted as an encoder for many state-It of-the-art automatic summarizing sys- tems, …...
Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models
AbstractStructural probing work has found evidence for latent syntactic information in pre-trained language models. However, much of this analysis has focused on monolingual models, and analyses of multilingual models have …...
SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese
Text classification is a typical natural lan- guage processing or computational linguis- tics task with various interesting applica- tions. As the number of users on social media platforms increases, data …...