Skip to Main content Skip to Navigation
Conference papers

An integrated system for teaching new visually grounded words to a robot for non-expert users using a mobile device

Pierre Rouanet 1 Pierre-Yves Oudeyer 1 David Filliat 1, 2
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : In this paper, we present a system allowing non- expert users to teach new words to their robot. In opposition to most of existing works in this area which focus on the associated visual perception and machine learning challenges, we choose to focus on the HRI challenges with the aim to show that it may improve the learning quality. We argue that by using mediator objects and in particular a handheld device, we can develop a human-robot interface which is not only intuitive and entertaining but will also "help" the user to provide "good" learning examples to the robot and thus will improve the efficiency of the whole learning system. The perceptual and machine learning parts of this system rely on an incremental version of visual bag-of-words. We also propose a system called ASMAT that makes it possible for the robot to incrementally build a model of a novel unknown object by simultaneously modelling and tracking it. We report experiments demonstrating the fast acquisition of robust object models using this approach.
Document type :
Conference papers
Complete list of metadata

Cited literature [31 references]  Display  Hide  Download
Contributor : Pierre Rouanet Connect in order to contact the contributor
Submitted on : Friday, December 4, 2009 - 9:51:48 AM
Last modification on : Thursday, January 21, 2021 - 9:26:01 AM
Long-term archiving on: : Thursday, October 18, 2012 - 9:45:40 AM


Files produced by the author(s)


  • HAL Id : inria-00438564, version 1



Pierre Rouanet, Pierre-Yves Oudeyer, David Filliat. An integrated system for teaching new visually grounded words to a robot for non-expert users using a mobile device. The 9th IEEE-RAS International Conference on Humanoid Robot, Dec 2009, Paris, France. ⟨inria-00438564⟩



Record views


Files downloads