Progressive Module Replacing
method
ID: progressivemodulereplacing
Related Papers
Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression
AbstractRecent studies on compression of pretrained language models (e.g., BERT) usually use preserved accuracy as the metric for evaluation. In this paper, we propose two new metrics, label loyalty and …...