Byte Pair Encodings
method
ID: bytepairencodings
Related Papers
A Multilingual BPE Embedding Space for Universal Sentiment Lexicon Induction
AbstractWe present a new method for sentiment lexicon induction that is designed to be applicable to the entire range of typological diversity of the world’s languages. We evaluate our method …...
BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages
AbstractMorphologically-rich polysynthetic languages present a challenge for NLP systems due to data sparsity, and a common strategy to handle this issue is to apply subword segmentation. We investigate a wide …...