Pretrained Transformer Language Models
method
ID: pretrainedtransformerlanguagemodels
Related Papers
Byte Pair Encoding is Suboptimal for Language Model Pretraining
AbstractThe success of pretrained transformer language models (LMs) in natural language processing has led to a wide range of pretraining setups. In particular, these models employ a variety of subword …...
IITK@Detox at SemEval-2021 Task 5: Semi-Supervised Learning and Dice Loss for Toxic Spans Detection
AbstractIn this work, we present our approach and findings for SemEval-2021 Task 5 - Toxic Spans Detection. The task’s main aim was to identify spans to which a given text’s …...