Out of Vocabulary Words
Related Papers
A Three-Phase System for Chinese Named Entity Recognition
. The handling of out-of-vocabulary (OOV) words is one of the key points to a high performance lexical analysis in natural language processing. Among all OOV words, named entities (NE) …...
Exploiting Word Transformation in Statistical Machine Translation from Spanish to English
This paper investigates the use of morpho- syntactic information to reduce data- sparseness in statistical machine transla- tion from Spanish to English. In particular, word-alignment training is performed by applying …...
Composition filtrée et marqueurs de règles de réécriture pour une distance d’édition flexible. Application à la correction des mots hors vocabulaire [Filtered Composition and Markers for a Flexible Edit-Distance. Application to the Correction of Out-Of-Vocabulary Words.]
. We present an original and flexible implementation of the edit-distance: the filtered composition, a special kind of composition of two finite-state machines through a filter that mod- els all …...
Lexical Normalisation of Short Text Messages: Makn Sens a #twitter
Twitter provides access to large volumes of data in real time, but is notoriously noisy, hampering its utility for NLP. In this paper, we target out-of-vocabulary words in short text …...
Unified Dependency Parsing of Chinese Morphological and Syntactic Structures
Most previous approaches to syntactic pars- ing of Chinese rely on a preprocessing step of word segmentation, thereby assuming there was a clearly defined boundary between mor- phology and syntax …...
Stripping Adjectives: Integration Techniques for Selective Stemming in SMT Systems
In this paper we present an approach to re- duce data sparsity problems when translat- ing from morphologically rich languages into less inflected languages by selectively stemming certain word types. …...
Richer Interpolative Smoothing Based on Modified Kneser-Ney Language Modeling
In this work we present a generalisation of the Modified Kneser-Ney interpolative smoothing for richer smoothing via additional discount parameters. We provide mathematical under- pinning for the estimator of the …...
An Empirical Study of the Downstream Reliability of Pre-Trained Word Embeddings
AbstractWhile pre-trained word embeddings have been shown to improve the performance of downstream tasks, many questions remain regarding their reliability: Do the same pre-trained word embeddings result in the best …...
Evaluating Sub-word Embeddings in Cross-lingual Models
AbstractCross-lingual word embeddings create a shared space for embeddings in two languages, and enable knowledge to be transferred between languages for tasks such as bilingual lexicon induction. One problem, however, …...
Evaluating a Joint Training Approach for Learning Cross-lingual Embeddings with Sub-word Information without Parallel Corpora on Lower-resource Languages
AbstractCross-lingual word embeddings provide a way for information to be transferred between languages. In this paper we evaluate an extension of a joint training approach to learning cross-lingual embeddings that …...
Federated Chinese Word Segmentation with Global Character Associations
Chinese word segmentation (CWS) is a fun- damental task for Chinese information pro- cessing, which always suffers from out-of- vocabulary word issues, especially when it is tested on data from …...
COIN – an Inexpensive and Strong Baseline for Predicting Out of Vocabulary Word Embeddings
AbstractSocial media is the ultimate challenge for many natural language processing tools. The constant emergence of linguistic constructs challenge even the most sophisticated NLP tools. Predicting word embeddings for out …...
Lemma Hunting: Automatic Spelling Normalization for German CMC Corpora
This paper presents and evaluates a method for automatic orthographic normalization and the treatment of out-of-vocabulary words (OOV) in German social media data. The system uses a cascade of spellchecking …...
Training on Lexical Resources
AbstractWe propose using lexical resources (thesaurus, VAD) to fine-tune pretrained deep nets such as BERT and ERNIE. Then at inference time, these nets can be used to distinguish synonyms from …...
Advancing Multi-Criteria Chinese Word Segmentation Through Criterion Classification and Denoising
AbstractRecent research on multi-criteria Chinese word segmentation (MCCWS) mainly focuses on building complex private structures, adding more handcrafted features, or introducing complex optimization processes. In this work, we show that …...