KenLM

We present KenLM, a library that imple- ments two data structures for efficient lan- guage model queries, reducing both time and memory costs. The PROBING data structure uses linear probing …...

AbstractEfficient methods for storing and querying are critical for scaling high-order m-gram language models to large corpora. We propose a language model based on compressed suffix trees, a representation that …...

For many applications, the query speed of N-gram language models is a computa- tional bottleneck. Although massively par- allel hardware like GPUs offer a poten- tial solution to this bottleneck, …...

In this paper, we attempt to improve Statistical Machine Translation (SMT) systems between Czech, Latvian and English in WNT’17 News translation task. We also participated in the Biomedical task and …...