Vision and Language Navigation
Related Papers
Are You Looking? Grounding to Multiple Modalities in Vision-and-Language Navigation
AbstractVision-and-Language Navigation (VLN) requires grounding instructions, such as “turn right and stop at the door”, to routes in a visual environment. The actual grounding can connect language to the environment …...
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation
AbstractAdvances in learning and representations have reinvigorated work that connects language to other modalities. A particularly exciting direction is Vision-and-Language Navigation(VLN), in which agents interpret natural language instructions and visual …...
Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation
AbstractVision-and-Language Navigation (VLN) is a natural language grounding task where an agent learns to follow language instructions and navigate to specified destinations in real-world environments. A key challenge is to …...
Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Grounding
AbstractWe introduce Room-Across-Room (RxR), a new Vision-and-Language Navigation (VLN) dataset. RxR is multilingual (English, Hindi, and Telugu) and larger (more paths and instructions) than other VLN datasets. It emphasizes the …...
Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environments
AbstractIn the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle ‘off the path’ scenarios …...
Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas
AbstractVision and language navigation (VLN) is a challenging visually-grounded language understanding task. Given a natural language navigation instruction, a visual agent interacts with a graph-based environment equipped with panorama images …...
AVAST: Attentive Variational State Tracker in a Reinforced Navigator
AbstractRecently, emerging approaches have been proposed to deal with robotic navigation problems, especially vision-and-language navigation task which is one of the most realistic indoor navigation challenge tasks. This task can …...
Diagnosing Vision-and-Language Navigation: What Really Matters
AbstractVision-and-language navigation (VLN) is a multimodal task where an agent follows natural language instructions and navigates in visual environments. Multiple setups have been proposed, and researchers apply new model architectures …...
ULN: Towards Underspecified Vision-and-Language Navigation
AbstractVision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions. Despite the significant performance improvement, the wide use of fine-grained instructions …...