English Pretrained Language Models
material
ID: englishpretrainedlanguagemodels
Related Papers
Language Contamination Helps Explains the Cross-lingual Capabilities of English Pretrained Models
AbstractEnglish pretrained language models, which make up the backbone of many modern NLP systems, require huge amounts of unlabeled training data. These models are generally presented as being trained only …...