Expression constraints in multimodal human-computer interaction

Abstract : Empirical study of the usability of speech constraints in a multimodal human-computer environment. Thanks to recent scientific advances, it is now possible to design multimodal interfaces allowing the use of speech and gestures on a touchscreen. However, present speech recognizers and natural language interpreters cannot yet process spontaneous speech accurately. These limitations make it necessary to impose constraints on users' speech inputs. Thus, ergonomic studies are needed to provide user interface designers with efficient guidelines for the definition of usable speech constraints. We evolved a method for designing oral and multimodal (speech + 2D gestures) command languages, which could be interpreted reliably by present systems, and easy to learn through human-computer interaction (HCI). The empirical study presented here contributes to assessing the usability of such artificial languages in a realistic software environment. Analyses of the multimodal protocols collected indicate that all subjects were able to assimilate rapidly the given expression constraints, mainly while executing simple interactive tasks; in addition, these constraints, which had no noticeable effect on the subjects' activities, had a limited influence on their use of modalities. These results contribute to the validation of the method we propose for the design of tractable and usable multimodal command languages.
Type de document :
Communication dans un congrès
Henry Lieberman. International Conference on Intelligent User Interfaces 2000 - IUI'2000, 2000, New Orleans, United States. ACM Press, pp.225-228, 2000, Proceedings of the 5th international conference on Intelligent user interfaces. 〈10.1145/325737.325852〉
Liste complète des métadonnées

Littérature citée [11 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00107846
Contributeur : Noelle Carbonell <>
Soumis le : jeudi 19 octobre 2006 - 09:11:42
Dernière modification le : mercredi 29 novembre 2017 - 15:14:36
Document(s) archivé(s) le : vendredi 25 novembre 2016 - 12:48:38

Fichier

 Accès restreint
Fichier visible le : jamais

Connectez-vous pour demander l'accès au fichier

Identifiants

Collections

Citation

Sandrine Robbe, Noëlle Carbonell, Pierre Dauchy. Expression constraints in multimodal human-computer interaction. Henry Lieberman. International Conference on Intelligent User Interfaces 2000 - IUI'2000, 2000, New Orleans, United States. ACM Press, pp.225-228, 2000, Proceedings of the 5th international conference on Intelligent user interfaces. 〈10.1145/325737.325852〉. 〈inria-00107846〉

Partager

Métriques

Consultations de la notice

156