Устойчивость модели

metric ID: modelrobustness

Related Papers

Contrastive Zero-Shot Learning for Cross-Domain Slot Filling with Adversarial Attack

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractZero-shot slot filling has widely arisen to cope with data scarcity in target domains. However, previous approaches often ignore constraints between slot value representation and related slot description representation in …...

4232

A Comparative Study on Schema-Guided Dialogue State Tracking

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractFrame-based state representation is widely used in modern task-oriented dialog systems to model user intentions and slot values. However, a fixed design of domain ontology makes it difficult to extend …...

21812

Alignment Rationale for Natural Language Inference

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractDeep learning models have achieved great success on the task of Natural Language Inference (NLI), though only a few attempts try to explain their behaviors. Existing explanation methods usually pick …...

8280

Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractDespite recent progress, state-of-the-art question answering models remain vulnerable to a variety of adversarial attacks. While dynamic adversarial data collection, in which a human annotator tries to write examples that …...

31067

Posterior Differential Regularization with f-divergence for Improving Model Robustness

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractWe address the problem of enhancing model robustness through regularization. Specifically, we focus on methods that regularize the model posterior difference between clean and noisy inputs. Theoretically, we provide a …...

21788

Towards Robustness of Text-to-SQL Models against Synonym Substitution

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractRecently, there has been significant progress in studying neural networks to translate text descriptions into SQL queries. Despite achieving good performance on some public benchmarks, existing text-to-SQL models typically rely …...

8686

Counterfactually Augmented Data and Unintended Bias: The Case of Sexism and Hate Speech Detection

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractCounterfactually Augmented Data (CAD) aims to improve out-of-domain generalizability, an indicator of model robustness. The improvement is credited to promoting core features of the construct over spurious artifacts that happen …...

21063

Doubly-Trained Adversarial Data Augmentation for Neural Machine Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractNeural Machine Translation (NMT) models are known to suffer from noisy inputs. To make models robust, we generate adversarial augmentation samples that attack the model and preserve the source-side meaning …...

29044

Understanding and Improving Sequence-to-Sequence Pretraining for Neural Machine Translation

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractIn this paper, we present a substantial step in better understanding the SOTA sequence-to-sequence (Seq2Seq) pretraining for neural machine translation (NMT). We focus on studying the impact of the jointly …...

39201

How do humans perceive adversarial text? A reality check on the validity and naturalness of word-based adversarial attacks

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractNatural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks – malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. …...

38307