Preprocessing

method ID: preprocessing

Related Papers

PANGLYZER: Spanish Language Analysis System

Authors: nan

Publication: TIPSTER (1994)

DOI: nan

The purpose of this paper is to describe the functions and procedures of the eight components of the Panglyzer Spanish analyzer of the knowledge-based engine of the Pangloss machine translation …...

28975

Named Entity Recognition Using a Character-based Probabilistic Approach

Authors: nan

Publication: TIPSTER (2003)

DOI: nan

We present a named entity recognition and classification system that uses only probabilis- tic character-level features. Classifications by multiple orthographic tries are combined in a hidden Markov model framework to …...

41196

Combination of Arabic Preprocessing Schemes for Statistical Machine Translation

Authors: nan

Publication: TIPSTER (2006)

DOI: nan

Statistical machine translation is quite ro- bust when it comes to the choice of in- put representation. It only requires con- sistency between training and testing. As a result, there …...

6899

The RODRIGO Database

Authors: nan

Publication: TIPSTER (2010)

DOI: nan

AbstractAnnotation of digitized pages from historical document collections is very important to research on automatic extraction of text blocks, lines, and handwriting recognition. We have recently introduced a new handwritten …...

8026

Beyond SoNaR: towards the facilitation of large corpus building efforts

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

AbstractIn this paper we report on the experiences gained in the recent construction of the SoNaR corpus, a 500 MW reference corpus of contemporary, written Dutch. It shows what can …...

13570

Variations prosodiques en synthèse par sélection d’unités: l’exemple des phrases interrogatives (Prosodic variations in unit-based speech synthesis: the example of interrogative sentences) [in French]

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

Prosodic variations in unit-based speech synthesis: the example of interrogative sentences This paper proposes an automatic method to increase the number of possible prosodic variations in non-uniform unit-based speech synthesis. …...

1705

Towards a Hybrid Rule-based and Statistical Arabic-French Machine Translation System

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

Arabic is a morphologically rich and complex language, which presents signifi- cant challenges for natural language pro- cessing and machine translation. In this paper, we describe an ongoing effort to …...

28872

UKP-WSI: UKP Lab Semeval-2013 Task 11 System Description

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

In this paper, we describe the UKP Lab sys- tem participating in the Semeval-2013 task “Word Sense Induction and Disambiguation within an End-User Application”. Our ap- proach uses preprocessing, co-occurrence …...

23208

CoRoLa — The Reference Corpus of Contemporary Romanian Language

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

AbstractWe present the project of creating CoRoLa, a reference corpus of contemporary Romanian (from 1945 onwards). In the international context, the project finds its place among the initiatives of gathering …...

16710

KUNLPLab:Sentiment Analysis on Twitter Data

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

This paper presents the system submitted by KUNLPLab for SemEval-2014 Task9 - Subtask B: Message Polarity on Twitter data. Lexicon features and bag-of-words features are mainly used to represent the …...

22823

TwitterHawk: A Feature Bucket Based Approach to Sentiment Analysis

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

This paper describes TwitterHawk, a system for sentiment analysis of tweets which partici- pated in the SemEval-2015 Task 10, Subtasks A through D. The system performed com- petitively, most notably …...

22641

Analyzing Pre-processing Settings for Urdu Single-document Extractive Summarization

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

AbstractPreprocessing is a preliminary step in many fields including IR and NLP. The effect of basic preprocessing settings on English for text summarization is well-studied. However, there is no such …...

15073

OCLSP at SemEval-2016 Task 9: Multilayered LSTM as a Neural Semantic Dependency Parser

Authors: nan

Publication: TIPSTER (2016)

DOI: nan

Semantic dependency parsing aims at ex- tracting arcs and semantic role labels for all words in a sentence. In this paper, we propose a semantic dependency parser which is based …...

22398

The AFRL WMT17 Neural Machine Translation Training Task Submission

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

The WMT17 Neural Machine Translation Training Task aims to test various methods of training neural machine translation sys- tems. We describe the AFRL submission, including preprocessing and its knowledge distillation …...

27885

TDBot at SemEval-2019 Task 3: Context Aware Emotion Detection Using A Conditioned Classification Approach

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWith the system description it is shown how to use the context information while detecting the emotion in a dialogue. Some guidelines about how to handle emojis was also laid …...

25822

CAMeL Tools: An Open Source Python Toolkit for Arabic Natural Language Processing

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractWe present CAMeL Tools, a collection of open-source tools for Arabic natural language processing in Python. CAMeL Tools currently provides utilities for pre-processing, morphological modeling, Dialect Identification, Named Entity Recognition …...

13303

Handling Entity Normalization with no Annotated Corpus: Weakly Supervised Methods Based on Distributional Representation and Ontological Information

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractEntity normalization (or entity linking) is an important subtask of information extraction that links entity mentions in text to categories or concepts in a reference vocabulary. Machine learning based normalization …...

15247

KINNEWS and KIRNEWS: Benchmarking Cross-Lingual Text Classification for Kinyarwanda and Kirundi

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractRecent progress in text classification has been focused on high-resource languages such as English and Chinese. For low-resource languages, amongst them most African languages, the lack of well-annotated data and …...

3885

Morphology-rich Alphasyllabary Embeddings

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractWord embeddings have been successfully trained in many languages. However, both intrinsic and extrinsic metrics are variable across languages, especially for languages that depart significantly from English in morphology and …...

15052

Examining the Effects of Preprocessing on the Detection of Offensive Language in German Tweets

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

Preprocessing is essential for creating more ef- fective features and reducing noise in classifi- cation, especially in user-generated data (e.g. Twitter). How each individual preprocessing decision changes an individual classifier’s …...

1490

Multilingual Epidemic Event Extraction : From Simple Classification Methods to Open Information Extraction (OIE) and Ontology

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThere is an incredible amount of information available in the form of textual documents due to the growth of information sources. In order to get the information into an actionable …...

20203

Plumeria at SemEval-2022 Task 6: Sarcasm Detection for English and Arabic Using Transformers and Data Augmentation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractThe paper describes our submission to SemEval-2022 Task 6 on sarcasm detection and its five subtasks for English and Arabic. Sarcasm conveys a meaning which contradicts the literal meaning, and …...

25042

Reproducibility Issues for BERT-based Evaluation Metrics

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractReproducibility is of utmost concern in machine learning and natural language processing (NLP). In the field of natural language generation (especially machine translation), the seminal paper of Post (2018) has …...

31292