Acting on a visual world : the role of perception in multimodal HCI

Frédéric Wolff 1 Antonella De Angeli 1, 2 Laurent Romary 1
1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
2 CTL - Cognitive Technology Laboratory, Department of Psychology
Abstract : Following the ecological theory of perception, this paper investigates multimodal referring acts in Human-Computer Interaction. Preliminary results from a simulation experiment allow to: (a) clarify the effect of perceptual organization on multimodal communication; (b) provide guidelines for designing effective multimodal interfaces. Demonstrating that both the verbal and the gestural part of a referential act are influenced by perception, we confirm the need and the utility of taking into account perceptual organization to analyze referential expressions in a more robust way. As a conclusion, we show how these results can lead to an actual implementation of a gesture interpretation module directed by the reference analysis process.
keyword : geste Wizard of OZ gesture multimodal reference multimodale Magicien d'Oz
Type de document :
Communication dans un congrès
AAAI '98 Workshop: Representations for Multi-modal Human-Computer Interaction, Jul 1998, Madison, Wisconsin, United States. 6 p, 1998
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger
https://hal.inria.fr/inria-00107515
Contributeur : Laurent Romary <>
Soumis le : lundi 1 mars 2010 - 12:23:25
Dernière modification le : jeudi 11 janvier 2018 - 06:19:48
Document(s) archivé(s) le : jeudi 23 septembre 2010 - 11:57:35

Fichiers

AAAIBIS.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00107515, version 2

Collections

INRIA | LORIA | UNIV-LORRAINE

Citation

Frédéric Wolff, Antonella De Angeli, Laurent Romary. Acting on a visual world : the role of perception in multimodal HCI. AAAI '98 Workshop: Representations for Multi-modal Human-Computer Interaction, Jul 1998, Madison, Wisconsin, United States. 6 p, 1998. 〈inria-00107515v2〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

151

Téléchargements de fichiers

117

Contact


archive-ouverte@inria.fr