DynamicProgrammingEncoding
method
ID: dynamicprogrammingencoding
Related Papers
Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
AbstractThis paper introduces Dynamic Programming Encoding (DPE), a new segmentation algorithm for tokenizing sentences into subword units. We view the subword segmentation of output sentences as a latent variable that …...