Диагностические эксперименты

task ID: diagnosticexperiments

Related Papers

Would you describe a leopard as yellow? Evaluating crowd-annotations with justified and informative disagreement

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractSemantic annotation tasks contain ambiguity and vagueness and require varying degrees of world knowledge. Disagreement is an important indication of these phenomena. Most traditional evaluation methods, however, critically hinge upon …...

3942

Diagnosing Vision-and-Language Navigation: What Really Matters

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractVision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures …...

20971