Pilot Update Mechanism

Back to List
otherentity ID: pilotupdatemechanism

Related Papers

BERT Learns to Teach: Knowledge Distillation with Meta Learning

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe present Knowledge Distillation with Meta Learning (MetaDistil), a simple yet effective alternative to traditional knowledge distillation (KD) methods where the teacher model is fixed during training. We show the …...

38898