Data Cleaning
Related Papers
Building a Web Corpus of Czech
AbstractLarge corpora are essential to modern methods of computational linguistics and natural language processing. In this paper, we describe an ongoing project whose aim is to build a largest corpus …...
An Empirical Study on the Overlapping Problem of Open-Domain Dialogue Datasets
AbstractOpen-domain dialogue systems aim to converse with humans through text, and dialogue research has heavily relied on benchmark datasets. In this work, we observe the overlapping problem in DailyDialog and …...
No Domain Left behind
AbstractWe participated in the WMT General MT task and focus on four high resource language pairs: English to Chinese, Chinese to English, English to Japanese and Japanese to English). The …...
The Lexometer: A Shiny Application for Exploratory Analysis and Visualization of Corpus Data
AbstractOften performing even simple data science tasks with corpus data requires significant expertise in data science and programming languages like R and Python. With the aim of making quantitative research …...
The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022
AbstractThis system paper describes the Xiaomi Translation System for the IWSLT 2022 Simultaneous Speech Translation (noted as SST) shared task. We participate in the English-to-Mandarin Chinese Text-to-Text (noted as T2T) …...
Stanford MLab at SemEval-2023 Task 10: Exploring GloVe- and Transformer-Based Methods for the Explainable Detection of Online Sexism
AbstractIn this paper, we discuss the methods we applied at SemEval-2023 Task 10: Towards the Explainable Detection of Online Sexism. Given an input text, we perform three classification tasks to …...