Мультимодальный корпус
Related Papers
A Speech and Gesture Spatial Corpus in Assisted Living
AbstractAmbient Assisted Living (AAL) is the name for a European technology and innovation funding programme. AAL research field is about intelligent assistant systems for a healthier and safer life in …...
Multimodal Corpus of Multi-party Conversations in Second Language
AbstractWe developed a dialogue-based tutoring system for teaching English to Japanese students and plan to transfer the current software tutoring agent into an embodied robot in the hope that the …...
The Herme Database of Spontaneous Multimodal Human-Robot Dialogues
AbstractThis paper presents methodologies and tools for language resource (LR) construction. It describes a database of interactive speech collected over a three-month period at the Science Gallery in Dublin, where …...
Towards a Semantic Annotation of English Television News - Building and Evaluating a Constraint Grammar FrameNet
This paper presents work on the semantic annotation of a multimodal corpus of English television news. The annotation is performed on the second-by-second- aligned transcript layer, adding verb frame categories …...
Do You See What I Mean? Visual Resolution of Linguistic Ambiguities
Understanding language goes hand in hand with the ability to integrate complex contextual information obtained via per- ception. In this work, we present a novel task for grounded language understanding: …...
A Multimodal Corpus for the Assessment of Public Speaking Ability and Anxiety
AbstractThe ability to efficiently speak in public is an essential asset for many professions and is used in everyday life. As such, tools enabling the improvement of public speaking performance …...
How to Address Smart Homes with a Social Robot? A Multi-modal Corpus of User Interactions with an Intelligent Environment
AbstractIn order to explore intuitive verbal and non-verbal interfaces in smart environments we recorded user interactions with an intelligent apartment. Besides offering various interactive capabilities itself, the apartment is also …...
Adding Syntactic Annotations to Flickr30k Entities Corpus for Multimodal Ambiguous Prepositional-Phrase Attachment Resolution
We propose in this paper to add to the captions of the Flickr30k Entities corpus some syntactic annotations in order to study the joint processing of image and language features …...
Crowdsourced Multimodal Corpora Collection Tool
In recent years, more and more multimodal corpora have been created. To our knowledge there is no publicly available tool which allows for acquiring controlled multimodal data of people in …...
Modeling Collaborative Multimodal Behavior in Group Dialogues: The MULTISIMO Corpus
We present a multimodal corpus that has been recently developed within the MULTISIMO project and targets the investigation and modeling of collaborative aspects of multimodal behavior in groups that perform …...
Preliminary Analysis of Embodied Interactions between Science Communicators and Visitors Based on a Multimodal Corpus of Japanese Conversations in a Science Museum
This paper introduces preliminary analyses of embodied interactions, drawing on a multimodal corpus of Japanese conversations, which we video-recorded during scientific communications at a museum in Tokyo, the Miraikan. A …...
Recognizing Behavioral Factors while Driving: A Real-World Multimodal Corpus to Monitor the Driver’s Affective State
The presented study concentrates on the collection of emotional multimodal real-world in-car audio, video and physiological signal recordings while driving. To do so, three sensor systems were integrated in the …...
Adding Gesture, Posture and Facial Displays to the PoliModal Corpus of Political Interviews
AbstractThis paper introduces a multimodal corpus in the political domain, which on top of transcribed face-to-face interviews presents the annotation of facial displays, hand gestures and body posture. While the …...
Multimodal Corpus of Bidirectional Conversation of Human-human and Human-robot Interaction during fMRI Scanning
AbstractIn this paper we present investigation of real-life, bi-directional conversations. We introduce the multimodal corpus derived from these natural conversations alternating between human-human and human-robot interactions. The human-robot interactions were …...
RDG-Map: A Multimodal Corpus of Pedagogical Human-Agent Spoken Interactions.
AbstractThis paper presents a multimodal corpus of 209 spoken game dialogues between a human and a remote-controlled artificial agent. The interactions involve people collaborating with the agent to identify countries …...
Mutual Gaze and Linguistic Repetition in a Multimodal Corpus
AbstractThis paper investigates the correlation between mutual gaze and linguistic repetition, a form of alignment, which we take as evidence of mutual understanding. We focus on a multimodal corpus made …...