Цель нежелательности
method
ID: unlikelihoodobjective
Related Papers
Understanding by Understanding Not: Modeling Negation in Language Models
AbstractNegation is a core construction in natural language. Despite being very successful on many tasks, state-of-the-art pre-trained language models often handle negation incorrectly. To improve language models in this regard, …...
DisCup: Discriminator Cooperative Unlikelihood Prompt-tuning for Controllable Text Generation
AbstractPrompt learning with immensely large Casual Language Models (CLMs) has been shown promising for attribute-controllable text generation (CTG). However, vanilla prompt tuning tends to imitate training corpus characteristics beyond the …...
Summarizing Dialogues with Negative Cues
AbstractAbstractive dialogue summarization aims to convert a long dialogue content into its short form where the salient information is preserved while the redundant pieces are ignored. Different from the well-structured …...