Мұғалімнің күйдіруі

method ID: teacherannealing

Related Papers

BAM! Born-Again Multi-Task Networks for Natural Language Understanding

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractIt can be challenging to train multi-task neural networks that outperform or even match their single-task counterparts. To help address this, we propose using knowledge distillation where single-task models teach …...

37076