Icra 2014 Submission

Gambit responding to unscripted gesture and language.
As robots become more ubiquitous, it becomes increasingly important for untrained users to be able to interact with them intuitively and comfortably. Unfortunately, as our robots get more capable, they are getting more complicated to use, not less! In this project, we're trying to build a robot that can learn about the world from users, and follow instructions that a person might give naturally.

We asked users to tell the robot about objects without a script, so it could learn how people naturally talk about things. This video demonstrates the resulting system on the Gambit robot.