Corpus Cleaning

task ID: corpuscleaning

Related Papers

Word Alignment Based Parallel Corpora Evaluation and Cleaning Using Machine Learning Techniques

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

This paper presents a method for cleaning and evaluating parallel corpora using word alignments and machine learning algorithms. It is based on the assumption that parallel sentences have many word …...

3129

Character Mapping and Ad-hoc Adaptation: Edinburgh’s IWSLT 2020 Open Domain Translation System

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractThis paper describes the University of Edinburgh’s neural machine translation systems submitted to the IWSLT 2020 open domain Japanese↔Chinese translation task. On top of commonplace techniques like tokenisation and corpus …...

20545

T4T Solution: WMT21 Similar Language Task for the Spanish-Catalan and Spanish-Portuguese Language Pair

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThe main idea of this solution has been to focus on corpus cleaning and preparation and after that, use an out of box solution (OpenNMT) with its default published transformer …...

27765