Adversarial Attacks
Related Papers
Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation
AbstractNeural networks are part of many contemporary NLP systems, yet their empirical successes come at the price of vulnerability to adversarial attacks. Previous work has used adversarial training and data …...
Generating Natural Language Adversarial Examples through Probability Weighted Word Saliency
AbstractWe address the problem of adversarial attacks on text classification, which is rarely studied comparing to attacks on image classification. The challenge of this task is to generate adversarial examples …...
A Reinforced Generation of Adversarial Examples for Neural Machine Translation
AbstractNeural machine translation systems tend to fail on less decent inputs despite its significant efficacy, which may significantly harm the credibility of these systems—fathoming how and when neural-based systems fail …...
BERT-ATTACK: Adversarial Attack Against BERT Using BERT
AbstractAdversarial attacks for discrete data (such as texts) have been proved significantly more challenging than continuous data (such as images) since it is difficult to generate adversarial samples with gradient-based …...
ContraCAT: Contrastive Coreference Analytical Templates for Machine Translation
AbstractRecent high scores on pronoun translation using context-aware neural machine translation have suggested that current approaches work well. ContraPro is a notable example of a contrastive challenge set for English→German …...
From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks
AbstractAdversarial attacks are label-preserving modifications to inputs of machine learning classifiers designed to fool machines but not humans. Natural Language Processing (NLP) has mostly focused on high-level attack scenarios such …...
Generating Label Cohesive and Well-Formed Adversarial Claims
AbstractAdversarial attacks reveal important vulnerabilities and flaws of trained models. One potent type of attack are universal adversarial triggers, which are individual n-grams that, when appended to instances of a …...
Make Up Your Mind! Adversarial Generation of Inconsistent Natural Language Explanations
AbstractTo increase trust in artificial intelligence systems, a promising research direction consists of designing neural models capable of generating natural language explanations for their predictions. In this work, we show …...
T3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted Attack
AbstractAdversarial attacks against natural language processing systems, which perform seemingly innocuous modifications to inputs, can induce arbitrary mistakes to the target models. Though raised great concerns, such adversarial attacks can …...
Word-level Textual Adversarial Attacking as Combinatorial Optimization
AbstractAdversarial attacks are carried out to reveal the vulnerability of deep neural networks. Textual adversarial attacking is challenging because text is discrete and a small perturbation can bring significant change …...
A Closer Look into the Robustness of Neural Dependency Parsers Using Better Adversarial Examples
Previous work on adversarial attacks on depen- dency parsers has mostly focused on attack methods, as opposed to the quality of adver- sarial examples, which in previous work has been …...
Better Robustness by More Coverage: Adversarial and Mixup Data Augmentation for Robust Finetuning
Pretrained language models (PLMs) perform poorly under adversarial attacks. To im- prove the adversarial robustness, adversarial data augmentation (ADA) has been widely adopted to cover more search space of adver- …...
Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots
AbstractMultilingual models have demonstrated impressive cross-lingual transfer performance. However, test sets like XNLI are monolingual at the example level. In multilingual communities, it is common for polyglots to code-mix when …...
Contrasting Human- and Machine-Generated Word-Level Adversarial Examples for Text Classification
AbstractResearch shows that natural language processing models are generally considered to be vulnerable to adversarial attacks; but recent work has drawn attention to the issue of validating these adversarial inputs …...
Don’t Search for a Search Method — Simple Heuristics Suffice for Adversarial Text Attacks
AbstractRecently more attention has been given to adversarial attacks on neural networks for natural language processing (NLP). A central research topic has been the investigation of search algorithms and search …...
Evaluating Neural Model Robustness for Machine Comprehension
AbstractWe evaluate neural model robustness to adversarial attacks using different types of linguistic unit perturbations – character and word, and propose a new method for strategic sentence-level perturbations. We experiment …...
Frequency-Guided Word Substitutions for Detecting Textual Adversarial Examples
AbstractRecent efforts have shown that neural text processing models are vulnerable to adversarial examples, but the nature of these examples is poorly understood. In this work, we show that adversarial …...
Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer
AbstractAdversarial attacks and backdoor attacks are two common security threats that hang over deep learning. Both of them harness task-irrelevant features of data in their implementation. Text style is a …...
On Robustness of Neural Semantic Parsers
AbstractSemantic parsing maps natural language (NL) utterances into logical forms (LFs), which underpins many advanced NLP problems. Semantic parsers gain performance boosts with deep neural networks, but inherit vulnerabilities against …...
On the Transferability of Adversarial Attacks against Neural Text Classifier
AbstractDeep neural networks are vulnerable to adversarial attacks, where a small perturbation to an input alters the model prediction. In many cases, malicious inputs intentionally crafted for one model can …...
“That Is a Suspicious Reaction!”: Interpreting Logits Variation to Detect NLP Adversarial Attacks
AbstractAdversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research …...
On the Robustness of Offensive Language Classifiers
AbstractSocial media platforms are deploying machine learning based offensive language classification systems to combat hateful, racist, and other forms of offensive speech at scale. However, despite their real-world deployment, we …...
Practical Attacks on Machine Translation using Paraphrase
AbstractStudies show machine translation systems are vulnerable to adversarial attacks, where a small change to the input produces an undesirable change in system behavior. This work considers whether this vulnerability …...
Robust Conversational Agents against Imperceptible Toxicity Triggers
AbstractWarning: this paper contains content that maybe offensive or upsetting. Recent research in Natural Language Processing (NLP) has advanced the development of various toxicity detection models with the intention of …...
RoCBert: Robust Chinese Bert with Multimodal Contrastive Pretraining
AbstractLarge-scale pretrained language models have achieved SOTA results on NLP tasks. However, they have been shown vulnerable to adversarial attacks especially for logographic languages like Chinese. In this work, we …...
Can Large Language Models Be an Alternative to Human Evaluations?
AbstractHuman evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and …...
How do humans perceive adversarial text? A reality check on the validity and naturalness of word-based adversarial attacks
AbstractNatural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks – malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. …...
Learning the Legibility of Visual Text Perturbations
AbstractMany adversarial attacks in NLP perturb text in puts to produce visually similar strings (‘ergo’, ‘εrgo’) which are legible to humans but degrade model performance. Although preserving legibility is a …...
RMLM: A Flexible Defense Framework for Proactively Mitigating Word-level Adversarial Attacks
AbstractAdversarial attacks on deep neural networks keep raising security concerns in natural language processing research. Existing defenses focus on improving the robustness of the victim model in the training stage. …...