Жеткіліктілік

metric ID: sufficiency

Related Papers

Recognizing Insufficiently Supported Arguments in Argumentative Essays

Authors: nan

Publication: TIPSTER (2017)

DOI: nan

AbstractIn this paper, we propose a new task for assessing the quality of natural language arguments. The premises of a well-reasoned argument should provide enough evidence for accepting or rejecting …...

42471

Graph-based Argument Quality Assessment

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractThe paper presents a novel discourse-based approach to argument quality assessment defined as a graph classification task, where the depth of reasoning (argumentation) is evident from the number and type …...

20199

A Comparative Study of Faithfulness Metrics for Model Interpretability Methods

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractInterpretable methods to reveal the internal reasoning processes behind machine learning models have attracted increasing attention in recent years. To quantify the extent to which the identified interpretations truly reflect …...

39041

An Empirical Study on Explanations in Out-of-Domain Settings

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractRecent work in Natural Language Processing has focused on developing approaches that extract faithful explanations, either via identifying the most important tokens in the input (i.e. post-hoc explanations) or by …...

38905

Incorporating Attribution Importance for Improving Faithfulness Metrics

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractFeature attribution methods (FAs) are popular approaches for providing insights into the model reasoning process of making predictions. The more faithful a FA is, the more accurately it reflects which …...

38601

The Solvability of Interpretability Evaluation Metrics

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractFeature attribution methods are popular for explaining neural network predictions, and they are often evaluated on metrics such as comprehensiveness and sufficiency. In this paper, we highlight an intriguing property …...

33269