Everyone Can Do Magic: An Interactive Game with Speech and Gesture Recognition

Abstract : This paper presents a novel game design that allows players to learn how to cast magic spells that combine hand gestures and speech. This game uses the imperfect recognition performance in speech and gesture recognition systems to its advantage to make the game challenging and interesting. Our game uses a Wii remote encased in a wand and a microphone to track player's gestures and speech which are then recognized to determine if they have performed the spell correctly. Visual feedback then provides confirmation of success. Through the game, players learn to adjust their speaking and movement patterns in order to meet the requirements of the recognition systems. This effectively mimics the characteristics of casting spells correctly such that players are trying to adjust their performance so that an "oracle" recognizes their speech and movement to have a magical outcome. A user study has confirmed the validity of the idea and establishes the accuracy required to create an interesting game based on the theory of channels of flow. 
Type de document :
Communication dans un congrès
Hyun Seung Yang; Rainer Malaka; Junichi Hoshino; Jung Hyun Han. 9th International Conference on Entertainment Computing (ICEC), Sep 2010, Seoul, South Korea. Springer, Lecture Notes in Computer Science, LNCS-6243, pp.32-42, 2010, Entertainment Computing - ICEC 2010. 〈10.1007/978-3-642-15399-0_4〉
Liste complète des métadonnées

Littérature citée [8 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01055613
Contributeur : Hal Ifip <>
Soumis le : mercredi 13 août 2014 - 14:31:51
Dernière modification le : mercredi 16 août 2017 - 17:33:03
Document(s) archivé(s) le : mercredi 26 novembre 2014 - 23:57:29

Fichier

icec2010_submission_78.pdf
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Chris Wang, Zhiduo Liu, Sidney Fels. Everyone Can Do Magic: An Interactive Game with Speech and Gesture Recognition. Hyun Seung Yang; Rainer Malaka; Junichi Hoshino; Jung Hyun Han. 9th International Conference on Entertainment Computing (ICEC), Sep 2010, Seoul, South Korea. Springer, Lecture Notes in Computer Science, LNCS-6243, pp.32-42, 2010, Entertainment Computing - ICEC 2010. 〈10.1007/978-3-642-15399-0_4〉. 〈hal-01055613〉

Partager

Métriques

Consultations de la notice

89

Téléchargements de fichiers

184