Поиск по дереву Монте-Карло
Related Papers
Assessing Robustness of Text Classification through Maximal Safe Radius Computation
AbstractNeural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. In this paper, we focus on robustness …...
Task-Completion Dialogue Policy Learning via Monte Carlo Tree Search with Dueling Network
AbstractWe introduce a framework of Monte Carlo Tree Search with Double-q Dueling network (MCTS-DDU) for task-completion dialogue policy learning. Different from the previous deep model-based reinforcement learning methods, which uses …...
Textual Data Augmentation for Efficient Active Learning on Tiny Datasets
AbstractIn this paper we propose a novel data augmentation approach where guided outputs of a language generation model, e.g. GPT-2, when labeled, can improve the performance of text classifiers through …...
The DeepMind Chinese–English Document Translation System at WMT2020
AbstractThis paper describes the DeepMind submission to the Chinese→English constrained data track of the WMT2020 Shared Task on News Translation. The submission employs a noisy channel factorization as the backbone …...
Machine Translation Decoding beyond Beam Search
AbstractBeam search is the go-to method for decoding auto-regressive machine translation models. While it yields consistent improvements in terms of BLEU, it is only concerned with finding outputs with high …...
Designing an Automatic Agent for Repeated Language–based Persuasion Games
AbstractPersuasion games are fundamental in economics and AI research and serve as the basis for important applications. However, work on this setup assumes communication with stylized messages that do not …...
Enhancing Task-Specific Distillation in Small Data Regimes through Language Generation
AbstractLarge-scale pretrained language models have led to significant improvements in Natural Language Processing. Unfortunately, they come at the cost of high computational and storage requirements that complicate their deployment on …...
PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided MCTS Decoding
AbstractLarge language models (LM) based on Transformers allow to generate plausible long texts. In this paper, we explore how this generation can be further controlled at decoding time to satisfy …...