Көрініс графы
Related Papers
Are Scene Graphs Good Enough to Improve Image Captioning?
AbstractMany top-performing image captioning models rely solely on object features computed with an object detection model to generate image descriptions. However, recent studies propose to directly use scene graphs to …...
Diverse and Relevant Visual Storytelling with Scene Graph Embeddings
AbstractA problem in automatically generated stories for image sequences is that they use overly generic vocabulary and phrase structure and fail to match the distributional characteristics of human-generated text. We …...
Extend, don’t rebuild: Phrasing conditional graph modification as autoregressive sequence labelling
AbstractDeriving and modifying graphs from natural language text has become a versatile basis technology for information extraction with applications in many subfields, such as semantic parsing or knowledge graph construction. …...
LRRA:A Transparent Neural-Symbolic Reasoning Framework for Real-World Visual Question Answering
AbstractThe predominant approach of visual question answering (VQA) relies on encoding the imageand question with a ”black box” neural encoder and decoding a single token into answers suchas ”yes” or …...
Dynamic Multistep Reasoning based on Video Scene Graph for Video Question Answering
AbstractExisting video question answering (video QA) models lack the capacity for deep video understanding and flexible multistep reasoning. We propose for video QA a novel model which performs dynamic multistep …...
Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignment
AbstractUnpaired cross-lingual image captioning has long suffered from irrelevancy and disfluency issues, due to the inconsistencies of the semantic scene and syntax attributes during transfer. In this work, we propose …...