Are Pretrained Convolutions Better than Pretrained Transformers?

8448

Knowledge Triples

Source Entity	Relationship	Target Entity
Datasets Material	usedFor	Tasks Task
Language Models Material	appliesTo	Pretrain Finetune Paradigm Method
Pre-trained Language Models Method	uses	Convolutional Neural Networks Method
Pre-trained Language Models Method	uses	Transformers Method