Byte Pair Encodings

method ID: bytepairencodings

Related Papers

A Multilingual BPE Embedding Space for Universal Sentiment Lexicon Induction

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe present a new method for sentiment lexicon induction that is designed to be applicable to the entire range of typological diversity of the world’s languages. We evaluate our method …...

39619

BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractMorphologically-rich polysynthetic languages present a challenge for NLP systems due to data sparsity, and a common strategy to handle this issue is to apply subword segmentation. We investigate a wide …...

32851