Parameter Reducibility
metric
ID: parameterreducibility
Related Papers
Finding the Dominant Winning Ticket in Pre-Trained Language Models
AbstractThe Lottery Ticket Hypothesis suggests that for any over-parameterized model, a small subnetwork exists to achieve competitive performance compared to the backbone architecture. In this paper, we study whether there …...