About several Reference Processings in Multimodal Human-Computer Communication

Ali Choumane 1 Jacques Siroux 1
1 CORDIAL - Human-machine spoken dialogue
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, INRIA Rennes, ENSSAT - École Nationale Supérieure des Sciences Appliquées et de Technologie
Abstract : We are interested in multimodal systems that use the following modes and modalities : speech (and natural language) as input as well as output, gesture as input and visual as output using screen displays. The user exchanges with the system by gesture and/or oral statements in natural language. This exchange, encoded in the different modalities, carries the goal of the user and also the designation of objects (referents) needed to achieve this goal. The system must identify in a precise and non-ambiguous way the objects designated by the user. In this document, we expose a state of the art about the processing of referential activities in this particular context.We address methods and algorithms of processing of linguistic and multimodal referential activities. We also address problems relied to some designations by gesture. Our point of view is to situate studies and results within the framework aiming to propose generic solutions and to develop the GEORAL multimodal system.
Type de document :
[Research Report] PI 1845, 2007, pp.67
Liste complète des métadonnées

Littérature citée [41 références]  Voir  Masquer  Télécharger

Contributeur : Anne Jaigu <>
Soumis le : mardi 24 avril 2007 - 16:02:22
Dernière modification le : mercredi 16 mai 2018 - 11:23:02
Document(s) archivé(s) le : mercredi 7 avril 2010 - 03:25:24


Fichiers produits par l'(les) auteur(s)


  • HAL Id : inria-00143192, version 1


Ali Choumane, Jacques Siroux. About several Reference Processings in Multimodal Human-Computer Communication. [Research Report] PI 1845, 2007, pp.67. 〈inria-00143192〉



Consultations de la notice


Téléchargements de fichiers