Pruning Strategy
method
ID: pruningstrategy
Related Papers
On the weak link between importance and prunability of attention heads
AbstractGiven the success of Transformer-based models, two directions of study have emerged: interpreting role of individual attention heads and down-sizing the models for efficiency. Our work straddles these two streams: …...