Morfessor
Related Papers
Unsupervised Morphological Segmentation with Log-Linear Models
Morphological segmentation breaks words into morphemes (the basic semantic units). It is a key component for natural language pro- cessing systems. Unsupervised morphologi- cal segmentation is attractive, because in ev- …...
Linguistically Motivated Unsupervised Segmentation for Machine Translation
AbstractIn this paper we use statistical machine translation and morphology information from two different morphological analyzers to try to improve translation quality by linguistically motivated segmentation. The morphological analyzers we …...
Hebrew Morphological Preprocessing for Statistical Machine Translation
This paper presents a range of preprocess- ing solutions for Hebrew-English statisti- cal machine translation. Our best system, using a morphological analyzer, increases 3.5 BLEU points over a no-tokenization baseline …...
Edinburgh’s Syntax-Based Systems at WMT 2015
This paper describes the syntax-based sys- tems built at the University of Edinburgh for the WMT 2015 shared translation task. We developed systems for all language pairs except French-English. This …...
Leveraging Inflection Tables for Stemming and Lemmatization.
We present several methods for stemming and lemmatization based on discrimina- tive string transduction. We exploit the paradigmatic regularity of semi-structured inflection tables to identify stems in an un- supervised …...
From Segmentation to Analyses: a Probabilistic Model for Unsupervised Morphology Induction
AbstractA major motivation for unsupervised morphological analysis is to reduce the sparse data problem in under-resourced languages. Most previous work focus on segmenting surface forms into their constituent morphs (taking: …...
A Systematic Study of Leveraging Subword Information for Learning Word Representations
AbstractThe use of subword-level information (e.g., characters, character n-grams, morphemes) has become ubiquitous in modern word representation learning. Its importance is attested especially for morphologically rich languages which generate a …...