Tutoring Robots

Abstract : This project explores a novel experimental setup towards building spoken, multi-modally rich, and human-like multiparty tutoring agent. A setup is developed and a corpus is collected that targets the development of a dialogue system platform to explore verbal and nonverbal tutoring strategies in multiparty spoken interactions with embodied agents. The dialogue task is centered on two participants involved in a dialogue aiming to solve a card-ordering game. With the participants sits a tutor that helps the participants perform the task and organizes and balances their interaction. Different multimodal signals captured and auto-synchronized by different audio-visual capture technologies were coupled with manual annotations to build a situated model of the interaction based on the participants personalities, their temporally-changing state of attention, their conversational engagement and verbal dominance, and the way these are correlated with the verbal and visual feedback, turn-management, and conversation regulatory actions generated by the tutor. At the end of this chapter we discuss the potential areas of research and developments this work opens and some of the challenges that lie in the road ahead.
Type de document :
Communication dans un congrès
Yves Rybarczyk; Tiago Cardoso; João Rosas; Luis M. Camarinha-Matos. 9th International Summer Workshop on Multimodal Interfaces (eNTERFACE), Jul 2013, Lisbon, Portugal. Springer, IFIP Advances in Information and Communication Technology, AICT-425, pp.80-113, 2014, Innovative and Creative Developments in Multimodal Interaction Systems. 〈10.1007/978-3-642-55143-7_4〉
Liste complète des métadonnées

Littérature citée [54 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01350740
Contributeur : Hal Ifip <>
Soumis le : lundi 1 août 2016 - 15:34:03
Dernière modification le : jeudi 1 février 2018 - 16:44:02
Document(s) archivé(s) le : mercredi 2 novembre 2016 - 11:15:45

Fichier

978-3-642-55143-7_4_Chapter.pd...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Samer Al Moubayed, Jonas Beskow, Bajibabu Bollepalli, Ahmed Hussen-Abdelaziz, Martin Johansson, et al.. Tutoring Robots. Yves Rybarczyk; Tiago Cardoso; João Rosas; Luis M. Camarinha-Matos. 9th International Summer Workshop on Multimodal Interfaces (eNTERFACE), Jul 2013, Lisbon, Portugal. Springer, IFIP Advances in Information and Communication Technology, AICT-425, pp.80-113, 2014, Innovative and Creative Developments in Multimodal Interaction Systems. 〈10.1007/978-3-642-55143-7_4〉. 〈hal-01350740〉

Partager

Métriques

Consultations de la notice

64

Téléchargements de fichiers

15