Temporal Generalization
metric
ID: temporalgeneralization
Related Papers
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change
AbstractRecent research has revealed that neural language models at scale suffer from poor temporal generalization capability, i.e., language model pre-trained on static data from past years performs worse over time …...
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora
AbstractPretrained language models (PTLMs) are typically learned over a large, static corpus and further fine-tuned for various downstream tasks. However, when deployed in the real world, a PTLM-based model must …...