Generative Language Model
Related Papers
SFS-TUE: Compound Paraphrasing with a Language Model and Discriminative Reranking
This paper presents an approach for gener- ating free paraphrases of compounds (task 4 at SemEval 2013) by decomposing the train- ing data into a collection of templates and fillers …...
Generating Sentences by Editing Prototypes
AbstractWe propose a new generative language model for sentences that first samples a prototype sentence from the training corpus and then edits it into a new sentence. Compared to traditional …...
Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speech
AbstractUndermining the impact of hateful content with informed and non-aggressive responses, called counter narratives, has emerged as a possible solution for having healthier online communities. Thus, some NLP studies have …...
Differentially Private Language Models for Secure Data Sharing
AbstractTo protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal …...
MaChAmp at SemEval-2023 tasks 2, 3, 4, 5, 7, 8, 9, 10, 11, and 12: On the Effectiveness of Intermediate Training on an Uncurated Collection of Datasets.
AbstractTo improve the ability of language models to handle Natural Language Processing(NLP) tasks and intermediate step of pre-training has recently beenintroduced. In this setup, one takes a pre-trained language model, …...
Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe
AbstractPrivacy concerns have attracted increasing attention in data-driven products due to the tendency of machine learning models to memorize sensitive training data. Generating synthetic versions of such data with a …...