FDISTILL
method
ID: fdistill
Related Papers
f-Divergence Minimization for Sequence-Level Knowledge Distillation
AbstractKnowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by …...