Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective
33438Related Entities
BERT
Method
Consistency Regularized ILD
Method
GLUE
Material
KnowledgeDistillation
Method
Overfitting
Metric
Method
Method
Material
Method
Metric