BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?

8549

Knowledge Triples

Source Entity	Relationship	Target Entity
Analogies Task	analyzedBy	Transformer Based Language Models Method
Analogies Task	involves	Abstract Semantic Relations OtherEntity
Analogies Task	relatedTo	Commonsense Reasoning Method
BERT Method	comparesWith	Word Embedding Models Method
Transformer Based Language Models Method	includes	BERT Method
Transformer Based Language Models Method	includes	GPT-2 Material
Transformer Based Language Models Method	includes	RoBERTa Material