research
∙
05/31/2023
Adaptive Coordination in Social Embodied Rearrangement
We present the task of "Social Rearrangement", consisting of cooperative...
share
research
∙
04/17/2023
Pretrained Language Models as Visual Planners for Human Assistance
To make progress towards multi-modal AI assistants which can guide users...
research
∙
04/17/2023
Affordances from Human Videos as a Versatile Representation for Robotics
Building a robot that can understand and learn to interact by watching h...
research
∙
04/07/2023
Reduce, Reuse, Recycle: Modular Multi-Object Navigation
Our work focuses on the Multi-Object Navigation (MultiON) task, where an...
research
∙
10/12/2021
Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents
Communication between embodied AI agents has received increasing attenti...
research
∙
09/30/2021
Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environments
In the Vision-and-Language Navigation (VLN) task an embodied agent navig...
research
∙
07/23/2021
Cooperative Exploration for Multi-Agent Deep Reinforcement Learning
Exploration is critical for good results in deep reinforcement learning ...
research
∙
04/14/2021
GridToPix: Training Embodied Agents with Minimal Supervision
While deep reinforcement learning (RL) promises freedom from hand-labele...
research
∙
12/07/2020
MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigation
Navigation tasks in photorealistic 3D environments are challenging becau...
research
∙
08/28/2020
AllenAct: A Framework for Embodied AI Research
The domain of Embodied AI, in which agents learn to complete tasks throu...
research
∙
07/23/2020
Bridging the Imitation Gap by Adaptive Insubordination
Why do agents often obtain better reinforcement learning policies when i...
research
∙
07/09/2020
A Cordial Sync: Going Beyond Marginal Policies for Multi-Agent Embodied Tasks
Autonomous agents must learn to collaborate. It is not scalable to devel...
research
∙
12/24/2019
Audio-Visual Embodied Navigation
Moving around in the world is naturally a multisensory experience, but t...
research
∙
10/31/2019
TAB-VCR: Tags and Attributes based VCR Baselines
Reasoning is an important ability that we learn from a very early age. Y...
research
∙
04/11/2019
Two Body Problem: Collaborative Visual Task Completion
Collaboration is a necessary skill to perform tasks that are beyond one ...
research
∙
03/29/2018
Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering
Human conversation is a complex mechanism with subtle nuances. It is hen...
research
∙
09/23/2017
Compact Environment-Invariant Codes for Robust Visual Place Recognition
Robust visual place recognition (VPR) requires scene representations tha...
research
∙
04/11/2017
