Мұғалімнің күйдіруі
method
ID: teacherannealing
Related Papers
BAM! Born-Again Multi-Task Networks for Natural Language Understanding
AbstractIt can be challenging to train multi-task neural networks that outperform or even match their single-task counterparts. To help address this, we propose using knowledge distillation where single-task models teach …...