Метрика согласованности
metric
ID: consistencymetric
Related Papers
Sunny and Dark Outside?! Improving Answer Consistency in VQA through Entailed Question Generation
AbstractWhile models for Visual Question Answering (VQA) have steadily improved over the years, interacting with one quickly reveals that these models lack consistency. For instance, if a model answers “red” …...
A Fine-grained Interpretability Evaluation Benchmark for Neural NLP
AbstractWhile there is increasing concern about the interpretability of neural models, the evaluation of interpretability remains an open problem, due to the lack of proper evaluation datasets and metrics. In …...