Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, Epiciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
UBC - University of British Columbia (Vancouver Campus, , 2329 West Mall, Vancouver, BC, V6T 1Z4 /
Okanagan Campus, 3333 University Way, Kelowna, BC, V1V 1V7 - Canada)
Abstract : This paper presents a novel game design that allows
players to learn how to cast magic spells that combine hand gestures and
speech. This game uses the imperfect recognition performance in speech
and gesture recognition systems to its advantage to make the game
challenging and interesting. Our game uses a Wii remote encased in a
wand and a microphone to track player's gestures and speech which are
then recognized to determine if they have performed the spell correctly.
Visual feedback then provides confirmation of success. Through the game,
players learn to adjust their speaking and movement patterns in order to
meet the requirements of the recognition systems. This effectively
mimics the characteristics of casting spells correctly such that players
are trying to adjust their performance so that an "oracle" recognizes
their speech and movement to have a magical outcome. A user study has
confirmed the validity of the idea and establishes the accuracy required
to create an interesting game based on the theory of channels of
flow.
https://hal.inria.fr/hal-01055613 Contributor : Hal IfipConnect in order to contact the contributor Submitted on : Wednesday, August 13, 2014 - 2:31:51 PM Last modification on : Friday, December 18, 2020 - 5:30:02 PM Long-term archiving on: : Wednesday, November 26, 2014 - 11:57:29 PM
Chris Wang, Zhiduo Liu, Sidney Fels. Everyone Can Do Magic: An Interactive Game with
Speech and Gesture Recognition. 9th International Conference on Entertainment Computing (ICEC), Sep 2010, Seoul, South Korea. pp.32-42, ⟨10.1007/978-3-642-15399-0_4⟩. ⟨hal-01055613⟩