Ablation Studies
Related Papers
Team DoNotDistribute at SemEval-2020 Task 11: Features, Finetuning, and Data Augmentation in Neural Models for Propaganda Detection in News Articles
AbstractThis paper presents our systems for SemEval 2020 Shared Task 11: Detection of Propaganda Techniques in News Articles. We participate in both the span identification and technique classification subtasks and …...
Augmenting Legal Judgment Prediction with Contrastive Case Relations
AbstractExisting legal judgment prediction methods usually only consider one single case fact description as input, which may not fully utilize the information in the data such as case relations and …...
Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm
AbstractConventional wisdom in pruning Transformer-based language models is that pruning reduces the model expressiveness and thus is more likely to underfit rather than overfit. However, under the trending pretrain-and-finetune paradigm, …...
Event Temporal Relation Extraction with Bayesian Translational Model
AbstractExisting models to extract temporal relations between events lack a principled method to incorporate external knowledge. In this study, we introduce Bayesian-Trans, a Bayesian learning-based method that models the temporal …...
On “Scientific Debt” in NLP: A Case for More Rigour in Language Model Pre-Training Research
AbstractThis evidence-based position paper critiques current research practices within the language model pre-training literature. Despite rapid recent progress afforded by increasingly better pre-trained language models (PLMs), current PLM research practices …...