Frustratingly Simple Pretraining Alternatives to Masked Language Modeling

31853

Knowledge Triples

Source Entity Relationship Target Entity
comparesWith
BERT MEDIUM

OtherEntity

evaluatedIn
GLUE

Material

evaluatedIn
SQuAD

Material