Параллельді корпустар
Related Papers
Automating the Acquisition of Bilingual Terminology
As the acquisition problem of bilingual lists of terminological expressions is formidable, it is worthwhile to investigate methods to compile such lists as automatically as pos- sible. In this paper …...
LINGSTAT: An Interactive, Machine-Aided Translation System
In this paper we present the first implementation of LING- STAT, an interactive machine translation system designed to increase the productivity of a user, with little knowledge of the source …...
The Cambridge language survey
AbstractThe Cambridge Language Survey is a research project whose activities centre around the use of an Integrated Language Database, whereby a computerised dictionary is used for intelligent cross-reference during corpus …...
Automatic Alignment in Parallel Corpora
This paper addresses the alignment issue in the framework of exploitation of large bi- multilingual corpora for translation purposes. A generic alignment scheme is proposed that can meet varying requirements …...
Translating Collocations for Use in Bilingual Lexicons
Collocations are notoriously difficult for non-native speakers to translate, primarily because they are opaque and can not be translated on a word by word basis. We describe a program named …...
Trainable Coarse Bilingual Grammars for Parallel Text Bracketing
We describe two new strategies to automatic bracketing of parallel corpora, with particular appli- cation to languages where prior grammar resources are scarce: (1) coarse bilingual grammars, and (2) unsupervised …...
Slovene–English Datasets for MT
Advances in machine translation are becoming increasingly dependent on the availability of large scale language resources, in particular parallel corpora. The talk presents Slovene-English language resources that were developed as …...
A Cheap and Fast Way to Build Useful Translation Lexicons
The paper presents a statistical approach to automatic building of translation lexicons from parallel corpora. We briefly describe the pre-processing steps, a baseline iterative method, and the actual algorithm. The …...
An Approach Based on Multilingual Thesauri and Model Combination for Bilingual Lexicon Extraction
This paper focuses on exploiting different models and methods in bilingual lexicon extraction, either from parallel or comparable corpora, in specialized domains. First, a special attention is given to the …...
Using Noisy Biligual Data for Statistical Machine Translation
SMT systems rely on sufficient amount of parallel corpora to train the trans- lation model. This paper investigates possibilities to use word-to-word and phrase-to-phrase translations extracted not only from clean …...
Fine-Grained Word Sense Disambiguation Based on Parallel Corpora, Word Alignment, Word Clustering and Aligned Wordnets
The paper presents a method for word sense disambiguation based on parallel corpora. The method exploits recent advances in word alignment and word clustering based on automatic extraction of translation …...
Knowledge Intensive Word Alignment with KNOWA
In this paper we present KNOWA, an English/Italian word aligner, developed at ITC-irst, which relies mostly on information contained in bilingual dictionaries. The performances of KNOWA are compared with those …...
Syntax-Based Alignment: Supervised or Unsupervised?
Tree-based approaches to alignment model translation as a sequence of probabilistic op- erations transforming the syntactic parse tree of a sentence in one language into that of the other. The …...
A language-independent method for the alignement of parallel corpora
. The automatic alignment of parallel corpora is a very rich source of information for automatic translation, multilingual document indexing, information retrieval, etc. The rapid growth of the use of …...
Corpus Variations for Translation Lexicon Induction
AbstractLexical mappings (word translations) between languages are an invaluable resource for multilingual processing. While the problem of extracting lexical mappings from parallel corpora is well-studied, the task is more challenging …...
Word Alignment in English-Hindi Parallel Corpus Using Recency-Vector Approach: Some Studies
Word alignment using recency-vector based approach has recently become pop- ular. One major advantage of these tech- niques is that unlike other approaches they perform well even if the size …...
Pour l’évaluation externe des systèmes de TA par des méthodes fondées sur la tâche [For an external evaluation of MT systems by task-based methods]
. External methods for evaluating MT systems define various measures based on MT results and their usage. While operational systems are mostly evaluated since long by task- based methods, evaluation …...
Improved Sentence Alignment on Parallel Web Pages Using a Stochastic Tree Alignment Model
Parallel web pages are important source of training data for statistical machine translation. In this paper, we present a new approach to sentence alignment on parallel web pages. Parallel web …...
Paraphrasing Depending on Bilingual Context Toward Generalization of Translation Knowledge
This study presents a method to automat- ically acquire paraphrases using bilingual corpora, which utilizes the bilingual de- pendency relations obtained by projecting a monolingual dependency parse onto the other …...
Extraction de collocations et leurs équivalents de traduction à partir de corpus parallèles [Extracting collocations and their translations from parallel corpora]
. Identifying collocations in a text (e.g., break record) and correctly translating them (battre record vs. *casser record) represent key issues in machine translation, notably because of their prevalence in …...
An Empirical Study on Web Mining of Parallel Data
This paper 1 presents an empirical ap- proach to mining parallel corpora. Con- ventional approaches use a readily available collection of comparable, non- parallel corpora to extract parallel sen- tences. …...
Automatic Acquisition of Parallel Corpora from Websites with Dynamic Content
AbstractParallel corpora are indispensable resources for a variety of multilingual natural language processing tasks. This paper presents a technique for fully automatic construction of constantly growing parallel corpora. We propose …...
Bilingual Lexicon Induction: Effortless Evaluation of Word Alignment Tools and Production of Resources for Improbable Language Pairs
AbstractIn this paper, we present a simple protocol to evaluate word aligners on bilingual lexicon induction tasks from parallel corpora. Rather than resorting to gold standards, it relies on a …...
COLEPL and COLSLM: An Unsupervised WSD Approach to Multilingual Lexical Substitution, Tasks 2 and 3 SemEval 2010
In this paper, we present a word sense disambiguation (WSD) based system for multilingual lexical substitution. Our method depends on having a WSD system for English and an automatic word …...
Design and Development of Part-of-Speech-Tagging Resources for Wolof (Niger-Congo, spoken in Senegal)
AbstractIn this paper, we report on the design of a part-of-speech-tagset for Wolof and on the creation of a semi-automatically annotated gold standard. In order to achieve high-quality annotation relatively …...
Lattice Score Based Data Cleaning for Phrase-Based Statistical Machine Translation
Statistical machine translation relies heav- ily on parallel corpora to train its mod- els for translation tasks. While more and more bilingual corpora are readily avail- able, the quality of …...
NP Alignment in Bilingual Corpora
AbstractAligning the NPs of parallel corpora is logically halfway between the sentence- and word-alignment tasks that occupy much of the MT literature, but has received far less attention. NP alignment …...
The Role of Parallel Corpora in Bilingual Lexicography
AbstractThis paper describes an approach based on word alignment on parallel corpora, which aims at facilitating the lexicographic work of dictionary building. Although this method has been widely used in …...
A Bayesian Mixture Model for PoS Induction Using Multiple Features
In this paper we present a fully unsupervised syntactic class induction system formulated as a Bayesian multinomial mixture model, where each word type is constrained to belong to a single …...
Cognate Identification for a French - Romanian Lexical Alignment System: Empirical Study
This paper describes a cognate identifica- tion method, used by a lexical alignment system for French and Romanian. We combine statistical techniques and lin- guistic information to extract cognates from …...
Correcting Semantic Collocation Errors with L1-induced Paraphrases
We present a novel approach for automatic collocation error correction in learner English which is based on paraphrases extracted from parallel corpora. Our key assumption is that collocation errors are …...
Enriching a statistical machine translation system trained on small parallel corpora with rule-based bilingual phrases
In this paper, we present a new hybridisa- tion approach consisting of enriching the phrase table of a phrase-based statistical machine translation system with bilingual phrase pairs matching structural transfer …...
Multi-Source Transfer of Delexicalized Dependency Parsers
We present a simple method for transferring dependency parsers from source languages with labeled training data to target languages without labeled training data. We first demon- strate that delexicalized parsers …...
Collection of a Large Database of French-English SMT Output Corrections
AbstractCorpus-based approaches to machine translation (MT) rely on the availability of parallel corpora. To produce user-acceptable translation outputs, such systems need high quality data to be efficiency trained, optimized and …...
Constructing Parallel Corpora for Six Indian Languages via Crowdsourcing
Recent work has established the efficacy of Amazon’s Mechanical Turk for constructing parallel corpora for machine translation re- search. We apply this to building a collec- tion of parallel corpora …...
Efficient Discrimination Between Closely Related Languages
In this paper, we revisit the problem of language identification with the focus on proper discrimination between closely related languages. Strong similarities between certain languages make it very hard to …...
Parallel Data, Tools and Interfaces in OPUS
AbstractThis paper presents the current status of OPUS, a growing language resource of parallel corpora and related tools. The focus in OPUS is to provide freely available data sets in …...
Structural alignment of plain text books
AbstractText alignment is one of the main processes for obtaining parallel corpora. When aligning two versions of a book, results are often affected by unpaired sections ― sections which only …...
An Infinite Hierarchical Bayesian Model of Phrasal Translation
Modern phrase-based machine translation systems make extensive use of word- based translation models for inducing alignments from parallel corpora. This is problematic, as the systems are inca- pable of accurately …...
Name-aware Machine Translation
We propose a Name-aware Machine Translation (MT) approach which can tightly integrate name processing into MT model, by jointly annotating parallel cor- pora, extracting name-aware translation grammar and rules, adding …...
Transliteration Systems across Indian Languages Using Parallel Corpora
Hindi is the lingua-franca of India. Al- though all non-native speakers can com- municate well in Hindi, there are only a few who can read and write in it. In …...
Umelb: Cross-lingual Textual Entailment with Word Alignment and String Similarity Features
This paper describes The University of Mel- bourne NLP group submission to the Cross- lingual Textual Entailment shared task, our first tentative attempt at the task. The ap- proach involves …...
Automatic creation of WordNets from parallel corpora
AbstractIn this paper we present the evaluation results for the creation of WordNets for five languages (Spanish, French, German, Italian and Portuguese) using an approach based on parallel corpora. We …...
Benchmarking of English-Hindi parallel corpora
AbstractIn this paper we present several parallel corpora for EnglishâHindi and talk about their natures and domains. We also discuss briefly a few previous attempts in MT for translation from …...
Billions of Parallel Words for Free: Building and Using the EU Bookshop Corpus
AbstractThe European Union is a great source of high quality documents with translations into several languages. Parallel corpora from its publications are frequently used in various tasks, machine translation in …...
Collaboratively Annotating Multilingual Parallel Corpora in the Biomedical Domain—some MANTRAs
AbstractThe coverage of multilingual biomedical resources is high for the English language, yet sparse for non-English languages―an observation which holds for seemingly well-resourced, yet still dramatically low-resourced ones such as …...
Cross-lingual Word Sense Disambiguation for Predicate Labelling of French
. We address the problem of transferring semantic annotations, more specifically predicate labellings, from one language to another using parallel corpora. Previous work has transferred these annotations directly at the …...
Extrinsic evaluation of web-crawlers in machine translation: a study on Croatian-English for the tourism domain
We present an extrinsic evaluation of crawlers of parallel corpora from multi- lingual web sites in machine translation (MT). Our case study is on Croatian to English translation in the …...
Global Methods for Cross-lingual Semantic Role and Predicate Labelling
We address the problem of transferring semantic annotations to new languages using parallel corpora. Previous work has transferred these annotations on a token-to-token basis, an approach that is sensitive to …...
Inducing Discourse Connectives from Parallel Texts
Discourse connectives (e.g. however, because) are terms that explicitly express discourse rela- tions in a coherent text. While a list of discourse connectives is useful for both theoretical and empirical …...
TLAXCALA: a multilingual corpus of independent news
AbstractWe acquire corpora from the domain of independent news from the Tlaxcala website. We build monolingual corpora for 15 languages and parallel corpora for all the combinations of those 15 …...
One Tree is not Enough: Cross-lingual Accumulative Structure Transfer for Semantic Indeterminacy
We address the task of parsing semanti- cally indeterminate expressions, for which several correct structures exist that do not lead to differences in meaning. We present a novel non-deterministic structure …...
TBXTools: A Free, Fast and Flexible Tool for Automatic Terminology Extraction
The manual identification of terminology from specialized corpora is a complex task that needs to be addressed by flexible tools, in order to facilitate the construction of multilingual terminologies which …...
A Character-level Decoder without Explicit Segmentation for Neural Machine Translation
The existing machine translation systems, whether phrase-based or neural, have relied almost exclusively on word-level modelling with explicit segmentation. In this paper, we ask a fundamental question: can neural machine …...
A Multilingual, Multi-style and Multi-granularity Dataset for Cross-language Textual Similarity Detection
AbstractIn this paper we describe our effort to create a dataset for the evaluation of cross-language textual similarity detection. We present preexisting corpora and their limits and we explain the …...
Domain Adaptation in MT Using Titles in Wikipedia as a Parallel Corpus: Resources and Evaluation
AbstractThis paper presents how an state-of-the-art SMT system is enriched by using an extra in-domain parallel corpora extracted from Wikipedia. We collect corpora from parallel titles and from parallel fragments …...
Filtering Wiktionary Triangles by Linear Mbetween Distributed Word Models
AbstractWord translations arise in dictionary-like organization as well as via machine learning from corpora. The former is exemplified by Wiktionary, a crowd-sourced dictionary with editions in many languages. Ács et …...
If You Even Don’t Have a Bit of Bible: Learning Delexicalized POS Taggers
AbstractPart-of-speech (POS) induction is one of the most popular tasks in research on unsupervised NLP. Various unsupervised and semi-supervised methods have been proposed to tag an unseen language. However, many …...
Multilingual Aliasing for Auto-Generating Proposition Banks
AbstractSemantic Role Labeling (SRL) is the task of identifying the predicate-argument structure in sentences with semantic frame and role labels. For the English language, the Proposition Bank provides both a …...
Parallel Sentence Extraction from Comparable Corpora with Neural Network Features
AbstractParallel corpora are crucial for machine translation (MT), however they are quite scarce for most language pairs and domains. As comparable corpora are far more available, many studies have been …...
Providing a Catalogue of Language Resources for Commercial Users
AbstractLanguage resources (LR) are indispensable for the development of tools for machine translation (MT) or various kinds of computer-assisted translation (CAT). In particular language corpora, both parallel and monolingual are …...
Retrofitting Sense-Specific Word Vectors Using Parallel Text
Jauhar et al. (2015) recently proposed to learn sense-specific word representations by “retrofitting” standard distributional word rep- resentations to an existing ontology. We ob- serve that this approach does not …...
Semi-Supervised Learning for Neural Machine Translation
While end-to-end neural machine transla- tion (NMT) has made remarkable progress recently, NMT systems only rely on par- allel corpora for parameter estimation. Since parallel corpora are usually limited in …...
Automatic Identification of AltLexes using Monolingual Parallel Corpora
AbstractThe automatic identification of discourse relations is still a challenging task in natural language processing. Discourse connectives, such as since or but, are the most informative cues to identify explicit …...
Learning bilingual word embeddings with (almost) no bilingual data
AbstractMost methods to learn bilingual word embeddings rely on large parallel corpora, which is difficult to obtain for most language pairs. This has motivated an active research line to relax …...
A Survey of Domain Adaptation for Neural Machine Translation
AbstractNeural machine translation (NMT) is a deep learning based approach for machine translation, which yields the state-of-the-art translation performance in scenarios where large-scale parallel corpora are available. Although the high-quality …...
Biomedical term normalization of EHRs with UMLS
This paper presents a novel prototype for biomedical term normalization of electronic health record excerpts with the Unified Medical Language System (UMLS) Metathesaurus, a large, multi-lingual compendium of biomedical and …...
Building Named Entity Recognition Taggers via Parallel Corpora
The lack of hand curated data is a major impediment to developing statistical semantic processors for many of the world languages. Our paper aims to bridge this gap by leveraging …...
CATS: A Tool for Customized Alignment of Text Simplification Corpora
In text simplification (TS), parallel corpora consisting of original sentences and their manually simplified counterparts are very scarce and small in size, which impedes building supervised automated TS systems with …...
Cross-Lingual Abstract Meaning Representation Parsing
AbstractAbstract Meaning Representation (AMR) research has mostly focused on English. We show that it is possible to use AMR annotations for English as a semantic representation for sentences written in …...
Cross-lingual Argumentation Mining: Machine Translation (and a bit of Projection) is All You Need!
AbstractArgumentation mining (AM) requires the identification of complex discourse structures and has lately been applied with success monolingually. In this work, we show that the existing resources are, however, not …...
Improving Machine Translation of Educational Content via Crowdsourcing
The limited availability of in-domain training data is a major issue in the training of application-specific neural machine translation models. Professional outsourcing of bilingual data collections is costly and often …...
Multi-lingual Argumentative Corpora in English, Turkish, Greek, Albanian, Croatian, Serbian, Macedonian, Bulgarian, Romanian and Arabic
Argumentative corpora are costly to create and are available in only few languages with English dominating the area. In this paper we release the first publicly available corpora in all …...
Parallel Corpora for bi-lingual English-Ethiopian Languages Statistical Machine Translation
AbstractIn this paper, we describe an attempt towards the development of parallel corpora for English and Ethiopian Languages, such as Amharic, Tigrigna, Afan-Oromo, Wolaytta and Ge’ez. The corpora are used …...
ZAP: An Open-Source Multilingual Annotation Projection Framework
Previous work leveraged annotation projection as a convenient method to automatically generate linguistic resources such as treebanks or propbanks for new languages. This approach automatically transfers linguistic annotation from a …...
Corpora Generation for Grammatical Error Correction
AbstractGrammatical Error Correction (GEC) has been recently modeled using the sequence-to-sequence framework. However, unlike sequence transduction problems such as machine translation, GEC suffers from the lack of plentiful parallel data. …...
Data-efficient Neural Text Compression with Interactive Learning
AbstractNeural sequence-to-sequence models have been successfully applied to text compression. However, these models were trained on huge automatically induced parallel corpora, which are only available for a few domains and …...
A multi-source approach for Breton–French hybrid machine translation
AbstractCorpus-based approaches to machine translation (MT) have difficulties when the amount of parallel corpora to use for training is scarce, especially if the languages involved in the translation are highly …...
Document Sub-structure in Neural Machine Translation
AbstractCurrent approaches to machine translation (MT) either translate sentences in isolation, disregarding the context they appear in, or model context at the level of the full document, without a notion …...
From Disjoint Sets to Parallel Data to Train Seq2Seq Models for Sentiment Transfer
AbstractWe present a method for creating parallel data to train Seq2Seq neural networks for sentiment transfer. Most systems for this task, which can be viewed as monolingual machine translation (MT), …...
Noising Scheme for Data Augmentation in Automatic Post-Editing
AbstractThis paper describes POSTECH’s submission to WMT20 for the shared task on Automatic Post-Editing (APE). Our focus is on increasing the quantity of available APE data to overcome the shortage …...
ParaCrawl: Web-Scale Acquisition of Parallel Corpora
AbstractWe report on methods to create the largest publicly available parallel corpora by crawling the web, using open source software. We empirically compare alternative methods and publish benchmark data sets …...
Representing Multiword Term Variation in a Terminological Knowledge Base: a Corpus-Based Study
AbstractIn scientific and technical communication, multiword terms are the most frequent type of lexical units. Rendering them in another language is not an easy task due to their cognitive complexity, …...
Russian-English Bidirectional Machine Translation System
AbstractThis review depicts our submission to the WMT20 shared news translation task. WMT is the conference to assess the level of machine translation capabilities of organizations in the word. We …...
UAlberta at SemEval-2020 Task 2: Using Translations to Predict Cross-Lingual Entailment
AbstractWe investigate the hypothesis that translations can be used to identify cross-lingual lexical entailment. We propose novel methods that leverage parallel corpora, word embeddings, and multilingual lexical resources. Our results …...
Using Multilingual Resources to Evaluate CEFRLex for Learner Applications
AbstractThe Common European Framework of Reference for Languages (CEFR) defines six levels of learner proficiency, and links them to particular communicative abilities. The CEFRLex project aims at compiling lexical resources …...
Illinois Japanese ↔ English News Translation for WMT 2021
AbstractThis system paper describes an end-to-end NMT pipeline for the Japanese ↔ English news translation task as submitted to WMT 2021, where we explore the efficacy of techniques such as …...
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
AbstractIn this work, we present an information-theoretic framework that formulates cross-lingual language model pre-training as maximizing mutual information between multilingual-multi-granularity texts. The unified view helps us to better understand the …...
Neural Machine Translation in Low-Resource Setting: a Case Study in English-Marathi Pair
AbstractIn this paper and we explore different techniques of overcoming the challenges of low-resource in Neural Machine Translation (NMT) and specifically focusing on the case of English-Marathi NMT. NMT systems …...
Optimizing Word Alignments with Better Subword Tokenization
AbstractWord alignment identify translational correspondences between words in a parallel sentence pair and are used and for example and to train statistical machine translation and learn bilingual dictionaries or to …...
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning
AbstractExisting zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries, which are expensive and impractical for low-resource languages. To disengage from these dependencies, researchers have explored training multilingual …...
Constructing Parallel Corpora from COVID-19 News using MediSys Metadata
AbstractThis paper presents a collection of parallel corpora generated by exploiting the COVID-19 related dataset of metadata created with the Europe Media Monitor (EMM) / Medical Information System (MediSys) processing …...
Generating Code-Switched Text from Monolingual Text with Dependency Tree
Various methods have been proposed to generate code-switched texts. Many of these involve training neural networks and, in turn, require some (albeit small) amounts of code-switched texts or parallel corpora …...
Improved Data Augmentation for Translation Suggestion
AbstractTranslation suggestion (TS) models are used to automatically provide alternative suggestions for incorrect spans in sentences generated by machine translation. This paper introduces the system used in our submission to …...
ParaDetox: Detoxification with Parallel Data
AbstractWe present a novel pipeline for the collection of parallel data for the detoxification task. We collect non-toxic paraphrases for over 10,000 English toxic sentences. We also show that this …...
SciPar: A Collection of Parallel Corpora from Scientific Abstracts
AbstractThis paper presents SciPar, a new collection of parallel corpora created from openly available metadata of bachelor theses, master theses and doctoral dissertations hosted in institutional repositories, digital libraries of …...
Building Machine Translation Tools for Patent Language: A Data Generation Strategy at the European Patent Office
AbstractThe European Patent Office (EPO) is an international organisation responsible for granting patents and promoting global cooperation in the intellectual property world. With three official languages (English, German, French) and …...
Filtering and rescoring the CCMatrix corpus for Neural Machine Translation training
AbstractThere are several parallel corpora available for many language pairs, such as CCMatrix, built from mass downloads of web content and automatic detection of segments in one language and the …...
Return to the Source: Assessing Machine Translation Suitability
AbstractWe approach the task of assessing the suitability of a source text for translation by transferring the knowledge from established MT evaluation metrics to a model able to predict MT …...