metric ID: entailment

Related Papers

Learning to recognize features of valid textual entailments

Authors: nan

Publication: TIPSTER (2006)

DOI: nan

This paper advocates a new architecture for tex- tual inference in which finding a good alignment is separated from evaluating entailment. Current ap- proaches to semantic inference in question answer- …...

24252

Entailment above the word level in distributional semantics

Authors: nan

Publication: TIPSTER (2012)

DOI: nan

We introduce two ways to detect entail- ment using distributional semantic repre- sentations of phrases. Our first experiment shows that the entailment relation between adjective-noun constructions and their head nouns …...

43731

FBK-TR: SVM for Semantic Relatedeness and Corpus Patterns for RTE

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

This paper reports the description and scores of our system, FBK-TR, which participated at the SemEval 2014 task #1 "Evaluation of Compositional Distribu- tional Semantic Models on Full Sentences through …...

22844

SemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual Entailment

Authors: nan

Publication: TIPSTER (2014)

DOI: nan

This paper presents the task on the evalu- ation of Compositional Distributional Se- mantics Models on full sentences orga- nized for the first time within SemEval- 2014. Participation was open …...

22924

A large annotated corpus for learning natural language inference

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Understanding entailment and contradic- tion is fundamental to understanding nat- ural language, and inference about entail- ment and contradiction is a valuable test- ing ground for the development of seman- …...

34779

Do Supervised Distributional Methods Really Learn Lexical Inference Relations?

Authors: nan

Publication: TIPSTER (2015)

DOI: nan

Distributional representations of words have been recently used in supervised settings for recognizing lexical inference relations be- tween word pairs, such as hypernymy and en- tailment. We investigate a collection …...

23441

A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractTransfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks. Ideally, the linguistic levels of morphology, syntax and semantics would benefit each …...

32822

Multimodal Word Distributions

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractWord embeddings provide point representations of words containing useful semantic information. We introduce multimodal word distributions formed from Gaussian mixtures, for multiple word meanings, entailment, and rich uncertainty information. To …...

39967

Distributional Inclusion Vector Embedding for Unsupervised Hypernymy Detection

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractModeling hypernymy, such as poodle is-a dog, is an important generalization aid to many NLP tasks, such as entailment, relation extraction, and question answering. Supervised learning from labeled hypernym sources, …...

22331

Dynamic Multi-Level Multi-Task Learning for Sentence Simplification

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractSentence simplification aims to improve readability and understandability, based on several operations such as splitting, deletion, and paraphrasing. However, a valid simplified sentence should also be logically entailed by its …...

5476

Neural Activation Semantic Models: Computational lexical semantic models of localized neural activations

Authors: nan

Publication: TIPSTER (2018)

DOI: nan

AbstractNeural activation models have been proposed in the literature that use a set of example words for which fMRI measurements are available in order to find a mapping between word …...

5276

On the Robustness of Self-Attentive Models

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractThis work examines the robustness of self-attentive neural networks against adversarial input perturbations. Specifically, we investigate the attention and feature extraction mechanisms of state-of-the-art recurrent neural networks and self-attentive architectures …...

39813

Repurposing Entailment for Multi-Hop Question Answering Tasks

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractQuestion Answering (QA) naturally reduces to an entailment problem, namely, verifying whether some text entails the answer to a question. However, for multi-hop QA tasks, which require reasoning with multiple …...

21984

Word2Sense: Sparse Interpretable Word Embeddings

Authors: nan

Publication: TIPSTER (2019)

DOI: nan

AbstractWe present an unsupervised method to generate Word2Sense word embeddings that are interpretable — each dimension of the embedding space corresponds to a fine-grained sense, and the non-negative value of …...

39393

AnaLog: Testing Analytical and Deductive Logic Learnability in Language Models

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe investigate the extent to which pre-trained language models acquire analytical and deductive logical reasoning capabilities as a side effect of learning word prediction. We present AnaLog, a natural language …...

26521

IMPLI: Investigating NLI Models’ Performance on Figurative Language

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractNatural language inference (NLI) has been widely used as a task to train and evaluate models for language understanding. However, the ability of NLI models to perform inferences requiring understanding …...

39014

Entailment as Robust Self-Learner

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractEntailment has been recognized as an important metric for evaluating natural language understanding (NLU) models, and recent studies have found that entailment pretraining benefits weakly supervised fine-tuning. In this work, …...

37755

Stanford MLab at SemEval 2023 Task 7: Neural Methods for Clinical Trial Report NLI

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractWe present a system for natural language inference in breast cancer clinical trial reports, as framed by SemEval 2023 Task 7: Multi-evidence Natural Language Inference for Clinical Trial Data. In …...

24733

When Truth Matters - Addressing Pragmatic Categories in Natural Language Inference (NLI) by Large Language Models (LLMs)

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractIn this paper, we focus on the ability of large language models (LLMs) to accommodate different pragmatic sentence types, such as questions, commands, as well as sentence fragments for natural …...

26434