Compression of Pretrained Language Models
task
ID: compressionofpretrainedlanguagemodels
Related Papers
Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression
AbstractRecent studies on compression of pretrained language models (e.g., BERT) usually use preserved accuracy as the metric for evaluation. In this paper, we propose two new metrics, label loyalty and …...