Lattice BERT
method
ID: latticebert
Related Papers
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models
AbstractChinese pre-trained language models usually process text as a sequence of characters, while ignoring more coarse granularity, e.g., words. In this work, we propose a novel pre-training paradigm for Chinese …...