method ID: elle

Related Papers

ELLE: Efficient Lifelong Pre-training for Emerging Data

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractCurrent pre-trained language models (PLM) are typically trained with static data, ignoring that in real-world scenarios, streaming data of various sources may continuously grow. This requires PLMs to integrate the …...

32581