Acting on a visual world : the role of perception in multimodal HCI - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 1998

Acting on a visual world : the role of perception in multimodal HCI

Antonella de Angeli
  • Fonction : Auteur
Laurent Romary

Résumé

Following the ecological theory of perception, this paper investigates multimodal referring acts in Human-Computer Interaction. Preliminary results from a simulation experiment allow to: (a) clarify the effect of perceptual organization on multimodal communication; (b) provide guidelines for designing effective multimodal interfaces. Demonstrating that both the verbal and the gestural part of a referential act are influenced by perception, we confirm the need and the utility of taking into account perceptual organization to analyze referential expressions in a more robust way. As a conclusion, we show how these results can lead to an actual implementation of a gesture interpretation module directed by the reference analysis process.

Domaines

Autre [cs.OH]
Fichier principal
Vignette du fichier
98-R-021.pdf (117.94 Ko) Télécharger le fichier

Dates et versions

inria-00107515 , version 1 (13-01-2009)
inria-00107515 , version 2 (01-03-2010)

Identifiants

  • HAL Id : inria-00107515 , version 1

Citer

Frédéric Wolff, Antonella de Angeli, Laurent Romary. Acting on a visual world : the role of perception in multimodal HCI. AAAI '98 Workshop: Representations for Multi-modal Human-Computer Interaction, 1998, Madison Wisconsin, USA, 6 p. ⟨inria-00107515v1⟩
100 Consultations
138 Téléchargements

Partager

Gmail Facebook X LinkedIn More