Тор
Related Papers
Lattice Minimum Bayes-Risk Decoding for Statistical Machine Translation
We present Minimum Bayes-Risk (MBR) de- coding over translation lattices that compactly encode a huge number of translation hypothe- ses. We describe conditions on the loss func- tion that will …...
Spell Checking Techniques for Replacement of Unknown Words and Data Cleaning for Haitian Creole SMS Translation
We report results on translation of SMS mes- sages from Haitian Creole to English. We show improvements by applying spell check- ing techniques to unknown words and creating a lattice …...
A Dynamic Programming Algorithm for Computing N-gram Posteriors from Lattices
Efficient computation of n-gram posterior probabilities from lattices has applications in lattice-based minimum Bayes-risk de- coding in statistical machine translation and the estimation of expected document frequencies from spoken corpora. …...
Self-Attentional Models for Lattice Inputs
AbstractLattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent …...
Porous Lattice Transformer Encoder for Chinese NER
AbstractIncorporating lexicons into character-level Chinese NER by lattices is proven effective to exploitrich word boundary information. Previous work has extended RNNs to consume lattice inputsand achieved great success. However, due …...
Massive-scale Decoding for Text Generation using Lattices
AbstractConditional neural text generation models generate high-quality outputs, but often concentrate around a mode when what we really want is a diverse set of options. We present a search algorithm …...
Segmenting Numerical Substitution Ciphers
AbstractDeciphering historical substitution ciphers is a challenging problem. Example problems that have been previously studied include detecting cipher type, detecting plaintext language, and acquiring the substitution key for segmented ciphers. …...