Dict BERT
method
ID: dictbert
Related Papers
Dict-BERT: Enhancing Language Model Pre-training with Dictionary
AbstractPre-trained language models (PLMs) aim to learn universal language representations by conducting self-supervised training tasks on large-scale corpora. Since PLMs capture word semantics in different contexts, the quality of word …...