Normalization
Related Papers
Automated Proof Reading of Clinical Notes
. Misspellings, abbreviations and acronyms are very popular in clinical notes and can be an obstacle to high quality information extraction and classification. In addition, another important part of narrative …...
Paraphrasing 4 Microblog Normalization
Compared to the edited genres that have played a central role in NLP research, mi- croblog texts use a more informal register with nonstandard lexical items, abbreviations, and free orthographic …...
What to do about bad language on the internet
The rise of social media has brought compu- tational linguistics in ever-closer contact with bad language: text that defies our expecta- tions about vocabulary, spelling, and syntax. This paper surveys …...
A Framework for Translating SMS Messages
Short Messaging Service (SMS) has become a popular form of communication. While it is predominantly used for monolingual communication, it can be extremely useful for facilitating cross-lingual communication through statistical …...
Morphological Analysis for Japanese Noisy Text based on Character-level and Word-level Normalization
Social media texts are often written in a non-standard style and include many lexical variants such as insertions, phonetic substitutions, abbreviations that mimic spoken language. The nor- malization of such …...
POS Tagging of English-Hindi Code-Mixed Social Media Content
Code-mixing is frequently observed in user generated content on social media, especially from multilingual users. The linguistic complexity of such content is compounded by presence of spelling vari- ations, transliteration …...
SemEval-2014 Task 7: Analysis of Clinical Text
This paper describes the SemEval-2014, Task 7 on the Analysis of Clinical Text and presents the evaluation results. It fo- cused on two subtasks: (i) identification (Task A) and (ii) …...
TMUNSW: Identification of Disorders and Normalization to SNOMED-CT Terminology in Unstructured Clinical Notes
Unstructured clinical notes are rich sources for valuable patient information. Information extraction techniques can be employed to extract this valuable information, which in turn can be used to discover new …...
A Taxonomy of Specific Problem Classes in Text-to-Speech Synthesis: Comparing Commercial and Open Source Performance
AbstractCurrent state-of-the-art speech synthesizers for domain-independent systems still struggle with the challenge of generating understandable and natural-sounding speech. This is mainly because the pronunciation of words of foreign origin, inflections …...
Urdu Summary Corpus
AbstractLanguage resources, such as corpora, are important for various natural language processing tasks. Urdu has millions of speakers around the world but it is under-resourced in terms of standard evaluation …...
A Call for Clarity in Reporting BLEU Scores
AbstractThe field of machine translation faces an under-recognized problem because of inconsistency in the reporting of scores from its dominant metric. Although people refer to “the” BLEU score, BLEU is …...
Parsivar: A Language Processing Toolkit for Persian
With the growth of Internet usage, a massive amount of textual data is generated on social media and the Web. As the text on the Web are generated by different …...
Universal Dependency Parsing for Hindi-English Code-Switching
AbstractCode-switching is a phenomenon of mixing grammatical structures of two or more languages under varied social constraints. The code-switching data differ so radically from the benchmark corpora used in NLP …...
Up-cycling Data for Natural Language Generation
Museums and other cultural heritage institutions have large databases of information about the objects in their collections, and existing Natural Language Generation (NLG) systems can generate fluent and adaptive texts …...
Synthetic Data for English Lexical Normalization: How Close Can We Get to Manually Annotated Data?
AbstractSocial media is a valuable data resource for various natural language processing (NLP) tasks. However, standard NLP tools were often designed with standard texts in mind, and their performance decreases …...
Lemmatization of Historical Old Literary Finnish Texts in Modern Orthography
AbstractTexts written in Old Literary Finnish represent the first literary work ever written in Finnish starting from the 16th century. There have been several projects in Finland that have digitized …...