Fine-tuned Pre-trained Language Models
method
ID: finetunedpretrainedlanguagemodels
Related Papers
Calibrated Language Model Fine-Tuning for In- and Out-of-Distribution Data
AbstractFine-tuned pre-trained language models can suffer from severe miscalibration for both in-distribution and out-of-distribution (OOD) data due to over-parameterization. To mitigate this issue, we propose a regularized fine-tuning method. Our …...
ECNUICA at SemEval-2021 Task 11: Rule based Information Extraction Pipeline
AbstractThis paper presents our endeavor for solving task11, NLPContributionGraph, of SemEval-2021. The purpose of the task was to extract triples from a paper in the Nature Language Processing field for …...
Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach
AbstractFine-tuned pre-trained language models (LMs) have achieved enormous success in many natural language processing (NLP) tasks, but they still require excessive labeled data in the fine-tuning stage. We study the …...