Skip to Main content Skip to Navigation
Conference papers

Exploring the use of a handheld device in language teaching human-robot interaction

Abstract : In this paper, we are exploring a human-robot in- terface allowing non-expert users to easily and intu- itively teach new words to a robot. Many challenges may be addressed before achieving such behavior as joint attention, naming, categorization and search- ing. Instead of using direct interactions (such as gesture and voice recognition) which are not robust enough in unconstrained environments, we use here a handheld device as a mediator between the user and the robot. The device allows us, among other things, to display the robot's camera visual feed- back as well as interacting through user's gestures on the touchscreen. Thus, users are able to draw the robot's attention toward locations, to select a particular ob ject in the field of view of the robot, to name it and with our “active-searching” system to find it again later. An exploratory study has been carried out in order to get some early users opinions, which tend to show that users easily use the interface during robust interaction sessions.
Document type :
Conference papers
Complete list of metadata

Cited literature [19 references]  Display  Hide  Download
Contributor : Jérôme Béchu Connect in order to contact the contributor
Submitted on : Monday, September 28, 2009 - 2:45:23 PM
Last modification on : Friday, March 25, 2022 - 3:34:01 PM
Long-term archiving on: : Tuesday, June 15, 2010 - 8:55:18 PM


Files produced by the author(s)


  • HAL Id : inria-00420235, version 1



Pierre Rouanet, Pierre-Yves Oudeyer. Exploring the use of a handheld device in language teaching human-robot interaction. AISB 2009, Apr 2009, Edinburgh, United Kingdom. ⟨inria-00420235⟩



Record views


Files downloads