A Compositional Model for Gesture Definition

Abstract : The description of a gesture requires temporal analysis of values generated by input sensors and does not fit well the observer pattern traditionally used by frameworks to handle user input. The current solution is to embed particular gesture-based interactions, such as pinch-to-zoom, into frameworks by notifying when a whole gesture is detected. This approach suffers from a lack of flexibility unless the programmer performs explicit temporal analysis of raw sensors data. This paper proposes a compositional, declarative meta-model for gestures definition based on Petri Nets. Basic traits are used as building blocks for defining gestures; each one notifies the change of a feature value. A complex gesture is defined by the composition of other sub-gestures using a set of operators. The user interface behaviour can be associated to the recognition of the whole gesture or to any other sub-component, addressing the problem of granularity for the notification events. The meta-model can be instantiated for different gesture recognition supports and its definition has been validated through a proof of concept library. Sample applications have been developed for supporting multitouch gestures on iOS and full body gestures with Microsoft Kinect.
Type de document :
Communication dans un congrès
Marco Winckler; Peter Forbrig; Regina Bernhaupt. 4th International Conference on Human-Centered Software Engineering (HCSE), Oct 2012, Toulouse, France. Springer, Lecture Notes in Computer Science, LNCS-7623, pp.34-52, 2012, Human-Centered Software Engineering. 〈10.1007/978-3-642-34347-6_3〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01556826
Contributeur : Hal Ifip <>
Soumis le : mercredi 5 juillet 2017 - 15:39:22
Dernière modification le : mercredi 20 décembre 2017 - 17:38:25
Document(s) archivé(s) le : mardi 23 janvier 2018 - 21:24:51

Fichier

978-3-642-34347-6_3_Chapter.pd...
Fichiers produits par l'(les) auteur(s)

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Citation

Lucio Spano, Antonio Cisternino, Fabio Paternò. A Compositional Model for Gesture Definition. Marco Winckler; Peter Forbrig; Regina Bernhaupt. 4th International Conference on Human-Centered Software Engineering (HCSE), Oct 2012, Toulouse, France. Springer, Lecture Notes in Computer Science, LNCS-7623, pp.34-52, 2012, Human-Centered Software Engineering. 〈10.1007/978-3-642-34347-6_3〉. 〈hal-01556826〉

Partager

Métriques

Consultations de la notice

62

Téléchargements de fichiers

43