Acting on a visual world : the role of perception in multimodal HCI

Abstract : Following the ecological theory of perception, this paper investigates multimodal referring acts in Human-Computer Interaction. Preliminary results from a simulation experiment allow to: (a) clarify the effect of perceptual organization on multimodal communication; (b) provide guidelines for designing effective multimodal interfaces. Demonstrating that both the verbal and the gestural part of a referential act are influenced by perception, we confirm the need and the utility of taking into account perceptual organization to analyze referential expressions in a more robust way. As a conclusion, we show how these results can lead to an actual implementation of a gesture interpretation module directed by the reference analysis process.
Type de document :
Communication dans un congrès
AAAI '98 Workshop: Representations for Multi-modal Human-Computer Interaction, Jul 1998, Madison, Wisconsin, United States. 6 p, 1998
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00107515
Contributeur : Laurent Romary <>
Soumis le : lundi 1 mars 2010 - 12:23:25
Dernière modification le : jeudi 11 janvier 2018 - 06:19:48
Document(s) archivé(s) le : jeudi 23 septembre 2010 - 11:57:35

Fichiers

AAAIBIS.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00107515, version 2

Collections

Citation

Frédéric Wolff, Antonella De Angeli, Laurent Romary. Acting on a visual world : the role of perception in multimodal HCI. AAAI '98 Workshop: Representations for Multi-modal Human-Computer Interaction, Jul 1998, Madison, Wisconsin, United States. 6 p, 1998. 〈inria-00107515v2〉

Partager

Métriques

Consultations de la notice

140

Téléchargements de fichiers

103