Preprocessing
Related Papers
PANGLYZER: Spanish Language Analysis System
The purpose of this paper is to describe the functions and procedures of the eight components of the Panglyzer Spanish analyzer of the knowledge-based engine of the Pangloss machine translation …...
Named Entity Recognition Using a Character-based Probabilistic Approach
We present a named entity recognition and classification system that uses only probabilis- tic character-level features. Classifications by multiple orthographic tries are combined in a hidden Markov model framework to …...
Combination of Arabic Preprocessing Schemes for Statistical Machine Translation
Statistical machine translation is quite ro- bust when it comes to the choice of in- put representation. It only requires con- sistency between training and testing. As a result, there …...
The RODRIGO Database
AbstractAnnotation of digitized pages from historical document collections is very important to research on automatic extraction of text blocks, lines, and handwriting recognition. We have recently introduced a new handwritten …...
Beyond SoNaR: towards the facilitation of large corpus building efforts
AbstractIn this paper we report on the experiences gained in the recent construction of the SoNaR corpus, a 500 MW reference corpus of contemporary, written Dutch. It shows what can …...
Variations prosodiques en synthèse par sélection d’unités: l’exemple des phrases interrogatives (Prosodic variations in unit-based speech synthesis: the example of interrogative sentences) [in French]
Prosodic variations in unit-based speech synthesis: the example of interrogative sentences This paper proposes an automatic method to increase the number of possible prosodic variations in non-uniform unit-based speech synthesis. …...
Towards a Hybrid Rule-based and Statistical Arabic-French Machine Translation System
Arabic is a morphologically rich and complex language, which presents signifi- cant challenges for natural language pro- cessing and machine translation. In this paper, we describe an ongoing effort to …...
UKP-WSI: UKP Lab Semeval-2013 Task 11 System Description
In this paper, we describe the UKP Lab sys- tem participating in the Semeval-2013 task “Word Sense Induction and Disambiguation within an End-User Application”. Our ap- proach uses preprocessing, co-occurrence …...
CoRoLa — The Reference Corpus of Contemporary Romanian Language
AbstractWe present the project of creating CoRoLa, a reference corpus of contemporary Romanian (from 1945 onwards). In the international context, the project finds its place among the initiatives of gathering …...
KUNLPLab:Sentiment Analysis on Twitter Data
This paper presents the system submitted by KUNLPLab for SemEval-2014 Task9 - Subtask B: Message Polarity on Twitter data. Lexicon features and bag-of-words features are mainly used to represent the …...
TwitterHawk: A Feature Bucket Based Approach to Sentiment Analysis
This paper describes TwitterHawk, a system for sentiment analysis of tweets which partici- pated in the SemEval-2015 Task 10, Subtasks A through D. The system performed com- petitively, most notably …...
Analyzing Pre-processing Settings for Urdu Single-document Extractive Summarization
AbstractPreprocessing is a preliminary step in many fields including IR and NLP. The effect of basic preprocessing settings on English for text summarization is well-studied. However, there is no such …...
OCLSP at SemEval-2016 Task 9: Multilayered LSTM as a Neural Semantic Dependency Parser
Semantic dependency parsing aims at ex- tracting arcs and semantic role labels for all words in a sentence. In this paper, we propose a semantic dependency parser which is based …...
The AFRL WMT17 Neural Machine Translation Training Task Submission
The WMT17 Neural Machine Translation Training Task aims to test various methods of training neural machine translation sys- tems. We describe the AFRL submission, including preprocessing and its knowledge distillation …...
TDBot at SemEval-2019 Task 3: Context Aware Emotion Detection Using A Conditioned Classification Approach
AbstractWith the system description it is shown how to use the context information while detecting the emotion in a dialogue. Some guidelines about how to handle emojis was also laid …...
CAMeL Tools: An Open Source Python Toolkit for Arabic Natural Language Processing
AbstractWe present CAMeL Tools, a collection of open-source tools for Arabic natural language processing in Python. CAMeL Tools currently provides utilities for pre-processing, morphological modeling, Dialect Identification, Named Entity Recognition …...
Handling Entity Normalization with no Annotated Corpus: Weakly Supervised Methods Based on Distributional Representation and Ontological Information
AbstractEntity normalization (or entity linking) is an important subtask of information extraction that links entity mentions in text to categories or concepts in a reference vocabulary. Machine learning based normalization …...
KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi
AbstractRecent progress in text classification has been focused on high-resource languages such as English and Chinese. For low-resource languages, amongst them most African languages, the lack of well-annotated data and …...
Morphology-rich Alphasyllabary Embeddings
AbstractWord embeddings have been successfully trained in many languages. However, both intrinsic and extrinsic metrics are variable across languages, especially for languages that depart significantly from English in morphology and …...
Examining the Effects of Preprocessing on the Detection of Offensive Language in German Tweets
Preprocessing is essential for creating more ef- fective features and reducing noise in classifi- cation, especially in user-generated data (e.g. Twitter). How each individual preprocessing decision changes an individual classifier’s …...
Multilingual Epidemic Event Extraction : From Simple Classification Methods to Open Information Extraction (OIE) and Ontology
AbstractThere is an incredible amount of information available in the form of textual documents due to the growth of information sources. In order to get the information into an actionable …...
Plumeria at SemEval-2022 Task 6: Sarcasm Detection for English and Arabic Using Transformers and Data Augmentation
AbstractThe paper describes our submission to SemEval-2022 Task 6 on sarcasm detection and its five subtasks for English and Arabic. Sarcasm conveys a meaning which contradicts the literal meaning, and …...
Reproducibility Issues for BERT-based Evaluation Metrics
AbstractReproducibility is of utmost concern in machine learning and natural language processing (NLP). In the field of natural language generation (especially machine translation), the seminal paper of Post (2018) has …...