method
ID: zen
Related Papers
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations
AbstractThe pre-training of text encoders normally processes text as a sequence of tokens corresponding to small text units, such as word pieces in English and characters in Chinese. It omits …...