Белгісіз сөздерді анықтау

In various Asian languages, including Chinese, there is no space between words in texts. Thus, most Chinese NLP systems must perform word-segmentation (sentence tokenization). However, successful word-segmentation depends on having …...

We introduce a character-based chunking for un- known word identification in Japanese text. A major advantage of our method is an ability to detect low frequency unknown words of unrestricted …...

. This paper proposes a lexicon-constrained character model that com- bines both word and character features to solve complicated issues in Chinese morphological analysis. A Chinese character-based model constrained by …...