Subwords
Related Papers
Biomedical text retrieval in languages with a complex morphology
Document retrieval in languages with a rich and complex morphology – par- ticularly in terms of derivation and (single-word) composition – suffers from serious performance degradation with the stemming-only query-term-to-text-word …...
An MDL-based approach to extracting subword units for grapheme-to-phoneme conversion
We address a key problem in grapheme-to- phoneme conversion: the ambiguity in map- ping grapheme units to phonemes. Rather than using single letters and phonemes as units, we propose learning …...
Multitask Learning For Different Subword Segmentations In Neural Machine Translation
AbstractIn Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, …...
Robust Backed-off Estimation of Out-of-Vocabulary Embeddings
AbstractOut-of-vocabulary (oov) words cause serious troubles in solving natural language tasks with a neural network. Existing approaches to this problem resort to using subwords, which are shorter and more ambiguous …...
Revisiting Syllables in Language Modelling and Their Application on Low-Resource Machine Translation
AbstractLanguage modelling and machine translation tasks mostly use subword or character inputs, but syllables are seldom used. Syllables provide shorter sequences than characters, require less-specialised extracting rules than morphemes, and …...