Early Exit Mechanism
method
ID: earlyexitmechanism
Related Papers
A Global Past-Future Early Exit Method for Accelerating Inference of Pre-trained Language Models
AbstractEarly exit mechanism aims to accelerate the inference speed of large-scale pre-trained language models. The essential idea is to exit early without passing through all the inference layers at the …...
Accelerating BERT Inference for Sequence Labeling via Early-Exit
AbstractBoth performance and efficiency are crucial factors for sequence labeling tasks in many real-world scenarios. Although the pre-trained models (PTMs) have significantly improved the performance of various sequence labeling tasks, …...