Суреттерді алу
Related Papers
Query-by-Example Image Retrieval using Visual Dependency Representations
Image retrieval models typically represent images as bags-of-terms, a representation that is well- suited to matching images based on the presence or absence of terms. For some information needs, such …...
Multimodal Pivots for Image Caption Translation
We present an approach to improve sta- tistical machine translation of image de- scriptions by multimodal pivots defined in visual space. The key idea is to perform image retrieval over …...
Scene Graph Parsing as Dependency Parsing
AbstractIn this paper, we study the problem of parsing structured knowledge graphs from textual descriptions. In particular, we consider the scene graph representation that considers objects together with their attributes …...
Symbolic Inductive Bias for Visually Grounded Learning of Spoken Language
AbstractA widespread approach to processing spoken language is to first automatically transcribe it into text. An alternative is to use an end-to-end approach: recent works have proposed to learn semantic …...
Aligning Images and Text with Semantic Role Labels for Fine-Grained Cross-Modal Understanding
AbstractAs vision processing and natural language processing continue to advance, there is increasing interest in multimodal applications, such as image retrieval, caption generation, and human-robot interaction. These tasks require close …...