Decoding Algorithms
Related Papers
Randomized Decoding for Selection-and-Ordering Problems
The task of selecting and ordering infor- mation appears in multiple contexts in text generation and summarization. For in- stance, methods for title generation con- struct a headline by selecting …...
Joint Models for Chinese POS Tagging and Dependency Parsing
Part-of-speech (POS) is an indispensable fea- ture in dependency parsing. Current research usually models POS tagging and dependency parsing independently. This may suffer from error propagation problem. Our experiments show …...
Machine Translation Decoding beyond Beam Search
AbstractBeam search is the go-to method for decoding auto-regressive machine translation models. While it yields consistent improvements in terms of BLEU, it is only concerned with finding outputs with high …...
How do decoding algorithms distribute information in dialogue responses?
AbstractHumans tend to follow the Uniform Information Density (UID) principle by distributing information evenly in utterances. We study if decoding algorithms implicitly follow this UID principle, and under what conditions …...