MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
33995Related Entities
BERT
Method
Compression
Task
Layer Selection Strategy
Method
MINILM
Method
RoBERTa
Material
State of the Art
Metric
XLM-R
Material