Несупервизируемая сегментация слов
Related Papers
Improving Word Segmentation by Simultaneously Learning Phonotactics
The most accurate unsupervised word seg- mentation systems that are currently avail- able (Brent, 1999; Venkataraman, 2001; Goldwater, 2007) use a simple unigram model of phonotactics. While this sim- plifies …...
Improving nonparameteric Bayesian inference: experiments on unsupervised word segmentation with adaptor grammars
One of the reasons nonparametric Bayesian inference is attracting attention in computa- tional linguistics is because it provides a prin- cipled way of learning the units of generaliza- tion together …...
An Efficient Algorithm for Unsupervised Word Segmentation with Branching Entropy and MDL
This paper proposes a fast and simple unsuper- vised word segmentation algorithm that uti- lizes the local predictability of adjacent char- acter sequences, while searching for a least- effort representation …...
Unsupervised phonemic Chinese word segmentation using Adaptor Grammars
Adaptor grammars are a framework for expressing and performing inference over a variety of non-parametric linguistic models. These models currently provide state-of-the-art performance on unsuper- vised word segmentation from phonemic …...
Design of an Input Method for Taiwanese Hokkien using Unsupervized Word Segmentation for Language Modeling
This paper presents the challenges and the methodology followed in the design of a new Input Method (IME) for the Taiwanese (Hokkien) language. We first describe the context, the motivations …...
University of Rochester WMT 2017 NMT System Submission
We describe the neural machine trans- lation system submitted by the Univer- sity of Rochester to the Chinese-English language pair for the WMT 2017 news translation task. We applied unsuper- …...