Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher
4806Related Entities
BERT
Method
Capacity Gap Problem
Task
CIFAR 10
Material
CIFAR 100
Material
GLUEBenchmark
Material
Image Classification
Task
KnowledgeDistillation
Method
Model Compression
Task
Question Answering
Task
SQuAD 1.1
Material
SQuAD 2.0
Material