How2 Dataset
Related Papers
Multistage Fusion with Forget Gate for Multimodal Summarization in Open-Domain Videos
AbstractMultimodal summarization for open-domain videos is an emerging task, aiming to generate a summary from multisource information (video, audio, transcript). Despite the success of recent multiencoder-decoder frameworks on this task, …...
Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization
AbstractMultimodal abstractive summarization (MAS) models that summarize videos (vision modality) and their corresponding transcripts (text modality) are able to extract the essential information from massive multimodal data on the Internet. …...
Assist Non-native Viewers: Multimodal Cross-Lingual Summarization for How2 Videos
AbstractMultimodal summarization for videos aims to generate summaries from multi-source information (videos, audio transcripts), which has achieved promising progress. However, existing works are restricted to monolingual video scenarios, ignoring the …...
Enhancing Video Translation Context with Object Labels
AbstractWe present a simple yet efficient method to enhance the quality of machine translation models trained on multimodal corpora by augmenting the training text with labels of detected objects in …...