Exploring the use of a handheld device in language teaching human-robot interaction

Pierre Rouanet 1 Pierre-Yves Oudeyer 1
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : In this paper, we are exploring a human-robot in- terface allowing non-expert users to easily and intu- itively teach new words to a robot. Many challenges may be addressed before achieving such behavior as joint attention, naming, categorization and search- ing. Instead of using direct interactions (such as gesture and voice recognition) which are not robust enough in unconstrained environments, we use here a handheld device as a mediator between the user and the robot. The device allows us, among other things, to display the robot's camera visual feed- back as well as interacting through user's gestures on the touchscreen. Thus, users are able to draw the robot's attention toward locations, to select a particular ob ject in the field of view of the robot, to name it and with our “active-searching” system to find it again later. An exploratory study has been carried out in order to get some early users opinions, which tend to show that users easily use the interface during robust interaction sessions.
Type de document :
Communication dans un congrès
AISB 2009, Apr 2009, Edinburgh, United Kingdom. 2009
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger

Contributeur : Jérôme Béchu <>
Soumis le : lundi 28 septembre 2009 - 14:45:23
Dernière modification le : jeudi 16 novembre 2017 - 17:12:01
Document(s) archivé(s) le : mardi 15 juin 2010 - 20:55:18


Fichiers produits par l'(les) auteur(s)


  • HAL Id : inria-00420235, version 1



Pierre Rouanet, Pierre-Yves Oudeyer. Exploring the use of a handheld device in language teaching human-robot interaction. AISB 2009, Apr 2009, Edinburgh, United Kingdom. 2009. 〈inria-00420235〉



Consultations de la notice


Téléchargements de fichiers