Contextual Representation Fine Tuning

AbstractAs NLP models become larger, executing a trained model requires significant computational resources incurring monetary and environmental costs. To better respect a given inference budget, we propose a modification to …...