Relevance and Perceptual Constraints in Multimodal Referring Actions

Antonella De Angeli 1 Frédéric Wolff 1 Patrice Lopez 1 Laurent Romary 1
1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : This paper presents a first attempt to score the relevance of multimodal referring expressions within a task oriented environment. It is based upon the application of the ecological approach to multimodal system design, which in particular implies that perception has to play a central role in the understanding of a gestural designation. The results of an experimental work is presented, together with the scores obtained by combining the linguistic characteristic of the referring expression and the properties of the corresponding gestures (if any). Even if the calculus that we present has to be refined it seems to be already suited to validate our approach regarding the importance group salience and access type in the choice of a referring mode.
Mots-clés : contraintes perceptives Perceptual Constraints Relevance Theory Multimodality théorie de la Pertinence multimodalité référence
Type de document :
Communication dans un congrès
ESSLLI Workshop on Deixis, Demonstration & Deictic belief in Multimedia Contexts, Aug 1999, Utrecht, The Netherlands, 9 p, 1999
Liste complète des métadonnées
https://hal.inria.fr/inria-00098751
Contributeur : Laurent Romary <>
Soumis le : mardi 13 janvier 2009 - 11:18:46
Dernière modification le : jeudi 11 janvier 2018 - 06:19:48
Document(s) archivé(s) le : lundi 5 avril 2010 - 23:12:41

Fichiers

99-R-052.pdf

Identifiants

  • HAL Id : inria-00098751, version 1

Collections

INRIA | LORIA | UNIV-LORRAINE

Citation

Antonella De Angeli, Frédéric Wolff, Patrice Lopez, Laurent Romary. Relevance and Perceptual Constraints in Multimodal Referring Actions. ESSLLI Workshop on Deixis, Demonstration & Deictic belief in Multimedia Contexts, Aug 1999, Utrecht, The Netherlands, 9 p, 1999. 〈inria-00098751〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

135

Téléchargements de fichiers

125

Contact


archive-ouverte@inria.fr