Жапон морфологиялық талдау

This paper presents Japanese morphological analy- sis based on conditional random fields (CRFs). Pre- vious work in CRFs assumed that observation se- quence (word) boundaries were fixed. However, word boundaries …...

Social media texts are often written in a non-standard style and include many lexical variants such as insertions, phonetic substitutions, abbreviations that mimic spoken language. The nor- malization of such …...