Title: Towards agents that can interact with 3D environments
Abstract: In popular imagination, household robots that we can instruct to "bring me my red mug from the kitchen" are common. For a robot to execute such an instruction, it needs to parse and interpret natural language, understand the 3D environment it is in (e.g. what objects exist and how they are described), navigate to locate the target object, and then interact appropriately with the target object. I will talk about some recent work that introduces 3D datasets of interactive objects, and recent work that investigates various tasks requiring 3D object localization and interaction.
