Expressive Keyboards: Enriching Gesture-Typing on Mobile Devices

Jessalyn Alvina 1, 2, 3 Joseph Malloch 1, 2, 3 Wendy Mackay 1, 2, 3
2 EX-SITU - Extreme Interaction
LRI - Laboratoire de Recherche en Informatique, Inria Saclay - Ile de France
Abstract : Gesture-typing is an efficient, easy-to-learn, and error-tolerant technique for entering text on software keyboards. Our goal is to "recycle" users' otherwise-unused gesture variation to create rich output under the users' control, without sacrificing accuracy. Experiment 1 reveals a high level of existing gesture variation, even for accurate text, and shows that users can consciously vary their gestures under different conditions. We designed an Expressive Keyboard for a smart phone which maps input gesture features identified in Experiment 1 to a continuous output parameter space, i.e. RGB color. Experiment 2 shows that users can consciously modify their gestures, while retaining accuracy, to generate specific colors as they gesture-type. Users are more successful when they focus on output characteristics (such as red) rather than input characteristics (such as curviness). We designed an app with a dynamic font engine that continuously interpolates between several typefaces, as well as controlling weight and random variation. Experiment 3 shows that, in the context of a more ecologically-valid conversation task, users enjoy generating multiple forms of rich output. We conclude with suggestions for how the Expressive Keyboard approach can enhance a wide variety of gesture recognition applications.
Type de document :
Communication dans un congrès
ACM. Proceedings of the 29th ACM Symposium on User Interface Software and Technology (UIST 2016), Oct 2016, Tokyo, Japan. pp.583 - 593, 2016, 〈https://uist.acm.org/uist2016/〉. 〈10.1145/2984511.2984560〉
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01437054
Contributeur : Wendy Mackay <>
Soumis le : mardi 17 janvier 2017 - 00:21:05
Dernière modification le : jeudi 5 avril 2018 - 12:30:25
Document(s) archivé(s) le : mardi 18 avril 2017 - 12:28:16

Fichier

EK.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Jessalyn Alvina, Joseph Malloch, Wendy Mackay. Expressive Keyboards: Enriching Gesture-Typing on Mobile Devices. ACM. Proceedings of the 29th ACM Symposium on User Interface Software and Technology (UIST 2016), Oct 2016, Tokyo, Japan. pp.583 - 593, 2016, 〈https://uist.acm.org/uist2016/〉. 〈10.1145/2984511.2984560〉. 〈hal-01437054〉

Partager

Métriques

Consultations de la notice

510

Téléchargements de fichiers

148