How to Train BERT with an Academic Budget

30649

Knowledge Triples

Source Entity	Relationship	Target Entity
Masked Language Model Method	enhancedBy	Design Choices OtherEntity
Masked Language Model Method	enhancedBy	Hyperparameter Tuning Method
Masked Language Model Method	enhancedBy	Software Optimizations Method
Masked Language Model Method	evaluatedIn	GLUE Material