Гумбелевский Softmax
Related Papers
Interpretable Textual Neuron Representations for NLP
AbstractInput optimization methods, such as Google Deep Dream, create interpretable representations of neurons for computer vision DNNs. We propose and evaluate ways of transferring this technology to NLP. Our results …...
Adaptive Compression of Word Embeddings
AbstractDistributed representations of words have been an indispensable component for natural language processing (NLP) tasks. However, the large memory footprint of word embeddings makes it challenging to deploy NLP models …...
Rethinking Supervised Learning and Reinforcement Learning in Task-Oriented Dialogue Systems
AbstractDialogue policy learning for task-oriented dialogue systems has enjoyed great progress recently mostly through employing reinforcement learning methods. However, these approaches have become very sophisticated. It is time to re-evaluate …...
Syntactically-Informed Unsupervised Paraphrasing with Non-Parallel Data
AbstractPrevious works on syntactically controlled paraphrase generation heavily rely on large-scale parallel paraphrase data that is not easily available for many languages and domains. In this paper, we take this …...
Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitution
AbstractWe propose the first character-level white-box adversarial attack method against transformer models. The intuition of our method comes from the observation that words are split into subtokens before being fed …...