Міндеттемелер банкі
Related Papers
Do You Know That Florence Is Packed with Visitors? Evaluating State-of-the-art Models of Speaker Commitment
AbstractWhen a speaker, Mary, asks “Do you know that Florence is packed with visitors?”, we take her to believe that Florence is packed with visitors, but not if she asks …...
Evaluating BERT for natural language inference: A case study on the CommitmentBank
AbstractNatural language inference (NLI) datasets (e.g., MultiNLI) were collected by soliciting hypotheses for a given premise from annotators. Such data collection led to annotation artifacts: systems can identify the premise-hypothesis …...
Identifying inherent disagreement in natural language inference
AbstractNatural language inference (NLI) is the task of determining whether a piece of text is entailed, contradicted by or unrelated to another piece of text. In this paper, we investigate …...
Bipol: Multi-Axes Evaluation of Bias with Explainability in Benchmark Datasets
AbstractWe investigate five English NLP benchmark datasets (on the superGLUE leaderboard) and two Swedish datasets for bias, along multiple axes. The datasets are the following: Boolean Question (Boolq), CommitmentBank (CB), …...