Обучение маловероятности
method
ID: unlikelihoodtraining
Related Papers
BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data
AbstractMaintaining a consistent persona is essential for dialogue agents. Although tremendous advancements have been brought, the limited-scale of annotated personalized dialogue datasets is still a barrier towards training robust and …...
Implicit Unlikelihood Training: Improving Neural Text Generation with Reinforcement Learning
AbstractLikelihood training and maximization-based decoding result in dull and repetitive generated texts even when using powerful language models (Holtzman et al., 2019). Adding a loss function for regularization was shown …...