Көзқарас
Related Papers
Non-Verbal Cues for Discourse Structure
This paper addresses the issue of designing embodied conversational agents that exhibit appropriate posture shifts during dialogues with human users. Previous research has noted the importance of hand gestures, eye …...
An Exploration of Eye Gaze in Spoken Language Processing for Multimodal Conversational Interfaces
Motivated by psycholinguistic findings, we are currently investigating the role of eye gaze in spoken language understand- ing for multimodal conversational sys- tems. Our assumption is that, during hu- man …...
Automated Vocabulary Acquisition and Interpretation in Multimodal Conversational Systems
Motivated by psycholinguistic findings that eye gaze is tightly linked to human lan- guage production, we developed an unsuper- vised approach based on translation models to automatically learn the mappings …...
Incorporating Temporal and Semantic Information with Eye Gaze for Automatic Word Acquisition in Multimodal Conversational Systems
One major bottleneck in conversational sys- tems is their incapability in interpreting un- expected user language inputs such as out-of- vocabulary words. To overcome this problem, conversational systems must be …...
Fusing Eye Gaze with Speech Recognition Hypotheses to Resolve Exophoric References in Situated Dialogue
In situated dialogue humans often utter lin- guistic expressions that refer to extralinguistic entities in the environment. Correctly resolv- ing these references is critical yet challeng- ing for artificial agents …...
Latent Mixture of Discriminative Experts for Multimodal Prediction Modeling
During face-to-face conversation, people naturally integrate speech, gestures and higher level language interpretations to predict the right time to start talking or to give backchannel feedback. In this paper we …...
Multimodal Corpus of Multi-party Conversations in Second Language
AbstractWe developed a dialogue-based tutoring system for teaching English to Japanese students and plan to transfer the current software tutoring agent into an embodied robot in the hope that the …...
The REX corpora: A collection of multimodal corpora of referring expressions in collaborative problem solving dialogues
AbstractThis paper describes a collection of multimodal corpora of referring expressions, the REX corpora. The corpora have two notable features, namely (1) they include time-aligned extra-linguistic information such as participant …...
The AICO Multimodal Corpus – Data Collection and Preliminary Analyses
AbstractThis paper describes data collection and the first explorative research on the AICO Multimodal Corpus. The corpus contains eye-gaze, Kinect, and video recordings of human-robot and human-human interactions, and was …...