Cloze-driven Pretraining of Self-attention Networks

8975

Knowledge Triples

Source Entity	Relationship	Target Entity
Bi-Directional Transformer Model Method	evaluatedIn	GLUE Material
Bi-Directional Transformer Model Method	solves	Cloze Style Word Reconstruction Task Task
Pre-Training Method	appliesTo	Bi-Directional Transformer Model Method