Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains

8647

Knowledge Triples

Source Entity	Relationship	Target Entity
Inference Time Metric	affects	Pre-trained Language Models Method
Meta Knowledge Distillation Method	extends	KnowledgeDistillation Method
Multi-domain NLP Tasks Task	partOf	Natural Language Processing OtherEntity