Вызов схемы Винограда
Related Papers
Resolving Complex Cases of Definite Pronouns: The Winograd Schema Challenge
We examine the task of resolving complex cases of definite pronouns, specifically those for which traditional linguistic constraints on coreference (e.g., Binding Constraints, gender and number agreement) as well as …...
A Surprisingly Robust Trick for the Winograd Schema Challenge
AbstractThe Winograd Schema Challenge (WSC) dataset WSC273 and its inference counterpart WNLI are popular benchmarks for natural language understanding and commonsense reasoning. In this paper, we show that the performance …...
Combining Knowledge Hunting and Neural Language Models to Solve the Winograd Schema Challenge
AbstractWinograd Schema Challenge (WSC) is a pronoun resolution task which seems to require reasoning with commonsense knowledge. The needed knowledge is not present in the given text. Automatic extraction of …...
How Reasonable are Common-Sense Reasoning Tasks: A Case-Study on the Winograd Schema Challenge and SWAG
AbstractRecent studies have significantly improved the state-of-the-art on common-sense reasoning (CSR) benchmarks like the Winograd Schema Challenge (WSC) and SWAG. The question we ask in this paper is whether improved …...
Contrastive Self-Supervised Learning for Commonsense Reasoning
AbstractWe propose a self-supervised method to solve Pronoun Disambiguation and Winograd Schema Challenge problems. Our approach exploits the characteristic structure of training corpora related to so-called “trigger” words, which are …...
Precise Task Formalization Matters in Winograd Schema Evaluations
AbstractPerformance on the Winograd Schema Challenge (WSC), a respected English commonsense reasoning benchmark, recently rocketed from chance accuracy to 89% on the SuperGLUE leaderboard, with relatively little corroborating evidence of …...
The Sensitivity of Language Models and Humans to Winograd Schema Perturbations
AbstractLarge-scale pretrained language models are the major driving force behind recent improvements in perfromance on the Winograd Schema Challenge, a widely employed test of commonsense reasoning ability. We show, however, …...
WinoWhy: A Deep Diagnosis of Essential Commonsense Knowledge for Answering Winograd Schema Challenge
AbstractIn this paper, we present the first comprehensive categorization of essential commonsense knowledge for answering the Winograd Schema Challenge (WSC). For each of the questions, we invite annotators to first …...
Investigating associative, switchable and negatable Winograd items on renewed French data sets
AbstractThe Winograd Schema Challenge (WSC) consists of a set of anaphora resolution problems resolvable only by reasoning about world knowledge. This article describes the update of the existing French data …...
Bipol: Multi-Axes Evaluation of Bias with Explainability in Benchmark Datasets
AbstractWe investigate five English NLP benchmark datasets (on the superGLUE leaderboard) and two Swedish datasets for bias, along multiple axes. The datasets are the following: Boolean Question (Boolq), CommitmentBank (CB), …...