| HAL-Inria | Publications, software ... of Inria's scientists |
Conference papers
Acting on a visual world : the role of perception in multimodal HCI
Abstract : Following the ecological theory of perception, this paper investigates multimodal referring acts in Human-Computer Interaction. Preliminary results from a simulation experiment allow to: (a) clarify the effect of perceptual organization on multimodal communication; (b) provide guidelines for designing effective multimodal interfaces. Demonstrating that both the verbal and the gestural part of a referential act are influenced by perception, we confirm the need and the utility of taking into account perceptual organization to analyze referential expressions in a more robust way. As a conclusion, we show how these results can lead to an actual implementation of a gesture interpretation module directed by the reference analysis process.
Cited literature [14 references]
https://hal.inria.fr/inria-00107515
Contributor : Laurent Romary <>
Submitted on : Monday, March 1, 2010 - 12:23:25 PM
Last modification on : Thursday, March 5, 2020 - 4:52:00 PM
Document(s) archivé(s) le : Thursday, September 23, 2010 - 11:57:35 AM
Contributor : Laurent Romary <>
Submitted on : Monday, March 1, 2010 - 12:23:25 PM
Last modification on : Thursday, March 5, 2020 - 4:52:00 PM
Document(s) archivé(s) le : Thursday, September 23, 2010 - 11:57:35 AM
Files
AAAIBIS.pdf
Files produced by the author(s)