Кнесер-Ней
Related Papers
Large Language Models in Machine Translation
This paper reports on the benefits of large- scale statistical language modeling in ma- chine translation. A distributed infrastruc- ture is proposed which we use to train on up to …...
A Comparative Investigation of Morphological Language Modeling for the Languages of the European Union
We investigate a language model that com- bines morphological and shape features with a Kneser-Ney model and test it in a large crosslingual study of European languages. Even though the …...
Language Model Rest Costs and Space-Efficient Storage
Approximate search algorithms, such as cube pruning in syntactic machine translation, rely on the language model to estimate probabili- ties of sentence fragments. We contribute two changes that trade between …...
Language Modeling with Power Low Rank Ensembles
We present power low rank ensembles (PLRE), a flexible framework for n-gram language modeling where ensembles of low rank matrices and tensors are used to obtain smoothed probability estimates of …...
A Comparison between Count and Neural Network Models Based on Joint Translation and Reordering Sequences
We propose a conversion of bilingual sentence pairs and the corresponding word alignments into novel linear se- quences. These are joint translation and reordering (JTR) uniquely defined sequences, combining interdepending …...
Lexical Coherence Graph Modeling Using Word Embeddings
Coherence is established by semantic connec- tions between sentences of a text which can be modeled by lexical relations. In this pa- per, we introduce the lexical coherence graph (LCG), …...
Sparse Non-negative Matrix Language Modeling
AbstractWe present Sparse Non-negative Matrix (SNM) estimation, a novel probability estimation technique for language modeling that can efficiently incorporate arbitrary features. We evaluate SNM language models on two corpora: the …...