Сыныпқа бағытталған ерекшеліктерді өзін-өзі дистилляциялау
method
ID: classawarefeatureselfdistillation
Related Papers
Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Training
AbstractAdapting pre-trained language models (PrLMs) (e.g., BERT) to new domains has gained much attention recently. Instead of fine-tuning PrLMs as done in most previous work, we investigate how to adapt …...