Fine Tuning Strategies
Related Papers
Multi-Modal Open-Domain Dialogue
AbstractRecent work in open-domain conversational agents has demonstrated that significant improvements in humanness and user preference can be achieved via massive scaling in both pre-training data and model size (Adiwardana …...
Amazon Alexa AI’s System for IWSLT 2022 Offline Speech Translation Shared Task
AbstractThis paper describes Amazon Alexa AI’s submission to the IWSLT 2022 Offline Speech Translation Task. Our system is an end-to-end speech translation model that leverages pretrained models and cross modality …...
Improving Machine Reading Comprehension with Contextualized Commonsense Knowledge
AbstractTo perform well on a machine reading comprehension (MRC) task, machine readers usually require commonsense knowledge that is not explicitly mentioned in the given documents. This paper aims to extract …...
PALI-NLP at SemEval-2022 Task 4: Discriminative Fine-tuning of Transformers for Patronizing and Condescending Language Detection
AbstractPatronizing and condescending language (PCL) has a large harmful impact and is difficult to detect, both for human judges and existing NLP systems. At SemEval-2022 Task 4, we propose a …...