NSMC
material
ID: nsmc
Related Papers
An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks
AbstractTypically, tokenization is the very first step in most text processing works. As a token serves as an atomic unit that embeds the contextual information of text, how to define …...