Разрыв в производительности

metric ID: performancegap

Related Papers

Towards Situated Dialogue: Revisiting Referring Expression Generation

Authors: nan

Publication: TIPSTER (2013)

DOI: nan

In situated dialogue, humans and agents have mismatched capabilities of perceiving the shared environment. Their representations of the shared world are misaligned. Thus referring expression generation (REG) will need to …...

34942

SCDE: Sentence Cloze Dataset with High Quality Distractors From Examinations

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractWe introduce SCDE, a dataset to evaluate the performance of computational models through sentence prediction. SCDE is a human created sentence cloze dataset, collected from public school English examinations. Our …...

37465

Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractExisting goal-oriented dialogue datasets focus mainly on identifying slots and values. However, customer support interactions in reality often involve agents following multi-step procedures derived from explicitly-defined company policies as well. …...

21640

Investigating Robustness of Dialog Models to Popular Figurative Language Constructs

Authors: nan

Publication: TIPSTER (2021)

DOI: nan

AbstractHumans often employ figurative language use in communication, including during interactions with dialog systems. Thus, it is important for real-world dialog systems to be able to handle popular figurative language …...

31341

Evaluation of Off-the-shelf Speech Recognizers on Different Accents in a Dialogue Domain

Authors: nan

Publication: TIPSTER (2022)

DOI: nan

AbstractWe evaluate several publicly available off-the-shelf (commercial and research) automatic speech recognition (ASR) systems on dialogue agent-directed English speech from speakers with General American vs. non-American accents. Our results show …...

14478

Analyzing and Reducing the Performance Gap in Cross-Lingual Transfer with Fine-tuning Slow and Fast

Authors: nan

Publication: TIPSTER (2023)

DOI: nan

AbstractExisting research has shown that a multilingual pre-trained language model fine-tuned with one (source) language also performs well on downstream tasks for non-source languages, even though no fine-tuning is done …...

38636