Generalization Performance
Related Papers
An Empirical Study on Neural Keyphrase Generation
AbstractRecent years have seen a flourishing of neural keyphrase generation (KPG) works, including the release of several large-scale datasets and a host of new models to tackle them. Model performance …...
Does it Really Generalize Well on Unseen Data? Systematic Evaluation of Relational Triple Extraction Methods
AbstractThe ability to extract entities and their relations from unstructured text is essential for the automated maintenance of large-scale knowledge graphs. To keep a knowledge graph up-to-date, an extractor needs …...
Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping
AbstractFine-tuning over large pretrained language models (PLMs) has established many state-of-the-art results. Despite its superior performance, such fine-tuning can be unstable, resulting in significant variance in performance and potential risks …...
Large-scale Lifelong Learning of In-context Instructions and How to Tackle It
AbstractJointly fine-tuning a Pre-trained Language Model (PLM) on a pre-defined set of tasks with in-context instructions has been proven to improve its generalization performance, allowing us to build a universal …...