Skip to Main content Skip to Navigation
Journal articles

Dealing with variability when recognizing user's performance in natural 3D gesture interfaces

Anthony Sorel 1 Richard Kulpa 1, 2 Emmanuel Badier 2 Franck Multon 1, 2
2 MIMETIC - Analysis-Synthesis Approach for Virtual Human Simulation
IRISA-D6 - MEDIA ET INTERACTIONS, Inria Rennes – Bretagne Atlantique , UR2 - Université de Rennes 2
Abstract : Recognition of natural gestures is a key issue in many applications including videogames and other immersive applications. Whatever is the motion capture device, the key problem is to recognize a motion that could be performed by a range of different users, at an interactive frame rate. Hidden Markov Models (HMM) that are commonly used to recognize the performance of a user however rely on a motion representation that strongly affects the overall recognition rate of the system. In this paper, we propose to use a compact motion representation based on Morphology-Independent features and we evaluate its performance compared to classical representations. When dealing with 15 very similar upper limb motions, HMM based on Morphology-Independent features yield significantly higher recognition rate (84.9%) than classical Cartesian or angular data (70.4% and 55.0%, respectively). Moreover, when the unknown motions are performed by a large number of users who have never contributed to the learning process, the recognition rate of Morphology-Independent input feature only decreases slightly (down to 68.2% for a HMM trained with the motions of only one subject) compared to other features (25.3% for Cartesian features and 17.8% for angular features in the same conditions). The method is illustrated through an interactive demo in which three virtual humans have to interactively recognize and replay the performance of the user. Each virtual human is associated with a HMM recognizer based on the three different input features. Read More:
Document type :
Journal articles
Complete list of metadatas
Contributor : Franck Multon <>
Submitted on : Tuesday, September 3, 2013 - 9:48:45 AM
Last modification on : Wednesday, October 14, 2020 - 4:13:46 AM

Links full text



Anthony Sorel, Richard Kulpa, Emmanuel Badier, Franck Multon. Dealing with variability when recognizing user's performance in natural 3D gesture interfaces. International Journal of Pattern Recognition and Artificial Intelligence, World Scientific Publishing, 2013, 27 (8), pp.19. ⟨10.1142/S0218001413500237⟩. ⟨hal-00857204⟩



Record views