Многоязычная модель
Related Papers
Speech-Input Multi-Target Machine Translation
In order to simultaneously translate speech into multiple languages an extension of stochastic finite-state transducers is pro- posed. In this approach the speech trans- lation model consists of a single …...
The University of Helsinki submissions to the IWSLT 2018 low-resource translation task
AbstractThis paper presents the University of Helsinki submissions to the Basque–English low-resource translation task. Our primary system is a standard bilingual Transformer system, trained on the available parallel data and …...
Multilingual Model Using Cross-Task Embedding Projection
AbstractWe present a method for applying a neural network trained on one (resource-rich) language for a given task to other (resource-poor) languages. We accomplish this by inducing a mapping from …...
Kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification
AbstractCode switching is a linguistic phenomenon which may occur within a multilingual setting where speakers share more than one language. With the increasing communication between groups with different languages, this …...
KS@LTH at SemEval-2020 Task 12: Fine-tuning Multi- and Monolingual Transformer Models for Offensive Language Detection
AbstractThis paper describes the KS@LTH system for SemEval-2020 Task 12 OffensEval2: Multilingual Offensive Language Identification in Social Media. We compare mono- and multilingual models based on fine-tuning pre-trained transformer models …...
To What Degree Can Language Borders Be Blurred In BERT-based Multilingual Spoken Language Understanding?
AbstractThis paper addresses the question as to what degree a BERT-based multilingual Spoken Language Understanding (SLU) model can transfer knowledge across languages. Through experiments we will show that, although it …...
Unified Humor Detection Based on Sentence-pair Augmentation and Transfer Learning
AbstractWe propose a unified multilingual model for humor detection which can be trained under a transfer learning framework. 1) The model is built based on pre-trained multilingual BERT, thereby is …...
Assessing Reference-Free Peer Evaluation for Machine Translation
AbstractReference-free evaluation has the potential to make machine translation evaluation substantially more scalable, allowing us to pivot easily to new languages or domains. It has been recently shown that the …...
Can Sequence-to-Sequence Models Crack Substitution Ciphers?
AbstractDecipherment of historical ciphers is a challenging problem. The language of the target plaintext might be unknown, and ciphertext can have a lot of noise. State-of-the-art decipherment methods use beam …...
Efficient Multilingual Text Classification for Indian Languages
AbstractIndia is one of the richest language hubs on the earth and is very diverse and multilingual. But apart from a few Indian languages, most of them are still considered …...
Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes
AbstractState-of-the-art contextual embeddings are obtained from large language models available only for a few languages. For others, we need to learn representations using a multilingual model. There is an ongoing …...
Mitigating Language-Dependent Ethnic Bias in BERT
AbstractIn this paper, we study ethnic bias and how it varies across languages by analyzing and mitigating ethnic bias in monolingual BERT for English, German, Spanish, Korean, Turkish, and Chinese. …...
An Unsupervised Multiple-Task and Multiple-Teacher Model for Cross-lingual Named Entity Recognition
AbstractCross-lingual named entity recognition task is one of the critical problems for evaluating the potential transfer learning techniques on low resource languages. Knowledge distillation using pre-trained multilingual language models between …...
Controlling Translation Formality Using Pre-trained Multilingual Language Models
AbstractThis paper describes the University of Maryland’s submission to the Special Task on Formality Control for Spoken Language Translation at IWSLT, which evaluates translation from English into 6 languages with …...
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment
AbstractWord alignment which aims to extract lexicon translation equivalents between source and target sentences, serves as a fundamental tool for natural language processing. Recent studies in this area have yielded …...
Multilingual and Multimodal Topic Modelling with Pretrained Embeddings
AbstractThis paper presents M3L-Contrast—a novel multimodal multilingual (M3L) neural topic model for comparable data that maps texts from multiple languages and images into a shared topic space. Our model is …...
Multilingual Neural Machine Translation With the Right Amount of Sharing
AbstractLarge multilingual Transformer-based machine translation models have had a pivotal role in making translation systems available for hundreds of languages with good zero-shot translation performance. One such example is the …...
Vocabulary-informed Language Encoding
AbstractA Multilingual model relies on language encodings to identify input languages because the multilingual model has to distinguish between the input and output languages or among all the languages for …...
Zero-shot Disfluency Detection for Indian Languages
AbstractDisfluencies that appear in the transcriptions from automatic speech recognition systems tend to impair the performance of downstream NLP tasks. Disfluency correction models can help alleviate this problem. However, the …...
KInITVeraAI at SemEval-2023 Task 3: Simple yet Powerful Multilingual Fine-Tuning for Persuasion Techniques Detection
AbstractThis paper presents the best-performing solution to the SemEval 2023 Task 3 on the subtask 3 dedicated to persuasion techniques detection. Due to a high multilingual character of the input …...
MultiTACRED: A Multilingual Version of the TAC Relation Extraction Dataset
AbstractRelation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English …...
Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review
AbstractIn recent years, pre-trained Multilingual Language Models (MLLMs) have shown a strong ability to transfer knowledge across different languages. However, given that the aspiration for such an ability has not …...