Multimodal Conversational Interaction with a Humanoid Robot

Adam Csapo Emer Gilmartin Jonathan Grizou 1 Jingguang Han Raveesh Meena Dimitra Anastasiou Kristiina Jokinen Graham Wilcock
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : The paper presents a multimodal conversational interaction system for the Nao humanoid robot. The system was developed at the 8th International Summer Workshop on Multi- modal Interfaces, Metz, 2012. We implemented WikiTalk, an existing spoken dialogue system for open-domain conversations, on Nao. This greatly extended the robot's interaction capabilities by enabling Nao to talk about an unlimited range of topics. In addition to speech interaction, we developed a wide range of multimodal interactive behaviours by the robot, including face- tracking, nodding, communicative gesturing, proximity detection and tactile interrupts. We made video recordings of user interac- tions and used questionnaires to evaluate the system. We further extended the robot's capabilities by linking Nao with Kinect.
Type de document :
Communication dans un congrès
CogInfoCom 2012 (3rd IEEE International Conference on Cognitive Infocommunications), Dec 2012, Kosice, Slovakia. 2012
Liste complète des métadonnées

https://hal.inria.fr/hal-00759810
Contributeur : Jonathan Grizou <>
Soumis le : dimanche 2 décembre 2012 - 21:16:17
Dernière modification le : jeudi 16 novembre 2017 - 17:12:03

Identifiants

  • HAL Id : hal-00759810, version 1

Collections

Citation

Adam Csapo, Emer Gilmartin, Jonathan Grizou, Jingguang Han, Raveesh Meena, et al.. Multimodal Conversational Interaction with a Humanoid Robot. CogInfoCom 2012 (3rd IEEE International Conference on Cognitive Infocommunications), Dec 2012, Kosice, Slovakia. 2012. 〈hal-00759810〉

Partager

Métriques

Consultations de la notice

145