LTG BERT
method
ID: ltgbert
Related Papers
Trained on 100 million words and still in shape: BERT meets British National Corpus
AbstractWhile modern masked language models (LMs) are trained on ever larger corpora, we here explore the effects of down-scaling training to a modestly-sized but representative, well-balanced, and publicly available English …...