ELLE
method
ID: elle
Related Papers
ELLE: Efficient Lifelong Pre-training for Emerging Data
AbstractCurrent pre-trained language models (PLM) are typically trained with static data, ignoring that in real-world scenarios, streaming data of various sources may continuously grow. This requires PLMs to integrate the …...