Пайдаланушының қанағаттануы
Related Papers
A Three-Tiered Evaluation Approach for Interactive Spoken Dialogue Systems
We describe a three-tiered approach for evaluation of spoken dialogue systems. The three tiers measure user satisfaction, system support of mission success and component performance. We describe our use of …...
DATE: A Dialogue Act Tagging Scheme for Evaluation of Spoken Dialogue Systems
This paper describes a dialogue act tagging scheme developed for the purpose of providing finer-grained quantitative dialogue met- rics for comparing and evaluating DARPA COMMUNICATOR spo- ken dialogue systems. We …...
Information Presentation in Spoken Dialogue Systems
To tackle the problem of presenting a large number of options in spoken dia- logue systems, we identify compelling op- tions based on a model of user preferences, and present …...
Modelling User Satisfaction and Student Learning in a Spoken Dialogue Tutoring System with Generic, Tutoring, and User Affect Parameters
We investigate using the PARADISE framework to develop predictive models of system performance in our spoken di- alogue tutoring system. We represent per- formance with two metrics: user satis- faction …...
Analysis and Presentation of Results for Mobile Local Search
AbstractAggregation of long lists of concepts is important to avoid overwhelming a small display. Focusing on the domain of mobile local search, this paper presents the development of an application …...
Utility Evaluation of Cross-document Information Extraction
We describe a utility evaluation to determine whether cross-document information extrac- tion (IE) techniques measurably improve user performance in news summary writing. Two groups of subjects were asked to perform …...
Comparing HMMs and Bayesian Networks for Surface Realisation
Natural Language Generation (NLG) systems often use a pipeline architecture for sequen- tial decision making. Recent studies how- ever have shown that treating NLG decisions jointly rather than in isolation …...
Evaluating the effects of interactivity in a post-editing workbench
AbstractThis paper describes the field trial and subsequent evaluation of a post-editing workbench which is currently under development in the EU-funded CasMaCat project. Based on user evaluations of the initial …...
Reading Comprehension of Machine Translation Output: What Makes for a Better Read?
AbstractThis paper reports on a pilot experiment that compares two different machine translation (MT) paradigms in reading comprehension tests. To explore a suitable methodology, we set up a pilot experiment …...
Learning from Dialogue after Deployment: Feed Yourself, Chatbot!
AbstractThe majority of conversations a dialogue agent sees over its lifetime occur after it has already been trained and deployed, leaving a vast store of potential training signal untapped. In …...
Adjusting Image Attributes of Localized Regions with Low-level Dialogue
AbstractNatural Language Image Editing (NLIE) aims to use natural language instructions to edit images. Since novices are inexperienced with image editing techniques, their instructions are often ambiguous and contain high-level …...
Ruler: Data Programming by Demonstration for Document Labeling
AbstractData programming aims to reduce the cost of curating training data by encoding domain knowledge as labeling functions over source data. As such it not only requires domain expertise but …...
Self-Supervised Contrastive Learning for Efficient User Satisfaction Prediction in Conversational Agents
AbstractTurn-level user satisfaction is one of the most important performance metrics for conversational agents. It can be used to monitor the agent’s performance and provide insights about defective user experiences. …...
Towards Building a Spoken Dialogue System for Argument Exploration
AbstractSpeech interfaces for argumentative dialogue systems (ADS) are rather scarce. The complex task they pursue hinders the application of common natural language understanding (NLU) approaches in this domain. To address …...