NLP наборы данных
Related Papers
Using Adversarial Examples in Natural Language Processing
Machine learning models have been providing promising results in many fields including natural language processing. These models are, nevertheless, prone to adversarial examples. These are artificially constructed examples which evince …...
ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts
AbstractThis work introduces a new multi-task, parameter-efficient language model (LM) tuning method that learns to transfer knowledge across different tasks via a mixture of soft prompts—small prefix embedding vectors pre-trained …...
MetaICL: Learning to Learn In Context
AbstractWe introduce MetaICL (Meta-training for In-Context Learning), a new meta-training framework for few-shot learning where a pretrained language model is tuned to do in-context learning on a large set of …...
Contrastive Novelty-Augmented Learning: Anticipating Outliers with Large Language Models
AbstractIn many task settings, text classification models are likely to encounter examples from novel classes on which they cannot predict correctly. Selective prediction, in which models abstain on low-confidence examples, …...
Self-Adaptive In-Context Learning: An Information Compression Perspective for In-Context Example Selection and Ordering
AbstractDespite the surprising few-shot performance of in-context learning (ICL), it is still a common practice to randomly sample examples to serve as context. This paper advocates a new principle for …...
Weaker Than You Think: A Critical Look at Weakly Supervised Learning
AbstractWeakly supervised learning is a popular approach for training machine learning models in low-resource settings. Instead of requesting high-quality yet costly human annotations, it allows training models with noisy annotations …...