МультимодальныеДанные
Related Papers
Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data
AbstractRecent years witness a growing interest in the use of multimodal data for modelling of communicative behaviour in dialogue. Dybkjaer and Bernsen (2002), point out that coding schemes for multimodal …...
The CAMOMILE Collaborative Annotation Platform for Multi-modal, Multi-lingual and Multi-media Documents
AbstractIn this paper, we describe the organization and the implementation of the CAMOMILE collaborative annotation framework for multimodal, multimedia, multilingual (3M) data. Given the versatile nature of the analysis which …...
Whodunnit? Crime Drama as a Case for Natural Language Understanding
AbstractIn this paper we argue that crime drama exemplified in television programs such as CSI: Crime Scene Investigation is an ideal testbed for approximating real-world natural language understanding and the …...
Integrating Text and Image: Determining Multimodal Document Intent in Instagram Posts
AbstractComputing author intent from multimodal data like Instagram posts requires modeling a complex relationship between text and image. For example, a caption might evoke an ironic contrast with the image, …...
Self-Supervised Multimodal Opinion Summarization
AbstractRecently, opinion summarization, which is the generation of a summary from multiple reviews, has been conducted in a self-supervised manner by considering a sampled review as a pseudo summary. However, …...
Collection Methods and Data Characteristics of the PagkataoKo Dataset
We present the PagkataoKo Dataset, a new dataset for Filipino Automatic Personal- ity Recognition (APR) containing demo- graphic, personality trait, and social media data sourced from 3,128 Filipino Instagram and/or …...
When to Laugh and How Hard? A Multimodal Approach to Detecting Humor and Its Intensity
AbstractPrerecorded laughter accompanying dialog in comedy TV shows encourages the audience to laugh by clearly marking humorous moments in the show. We present an approach for automatically detecting humor in …...
Large Scale Multi-Lingual Multi-Modal Summarization Dataset
AbstractSignificant developments in techniques such as encoder-decoder models have enabled us to represent information comprising multiple modalities. This information can further enhance many downstream tasks in the field of information …...