Skip to Main content Skip to Navigation
New interface
Conference papers

Constraints on the Use of Language, Gesture and Speech for Multimodal Dialogues

Bertrand Gaiffe 1 Laurent Romary 1 
1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : We try to show how language, gesture and perception can be seen in a uniform way from the perspective of referential analysis, by looking at the specific constraints which underly the speaker's choice of a given expression. To this end, we first situate the relative importance of speech and gesture in man-machine communication. Then, we concentrate upon the specific effects resulting from the combination of verbal, gestural and perceptual information, showing that on the one hand the three provide structural constraints to the objects which are being referred to and on the other hand that any referring operation, whatever its origin, has to be interpreted within a localized frame, with some consequences upon dialogue management.
Document type :
Conference papers
Complete list of metadata

Cited literature [4 references]  Display  Hide  Download
Contributor : Laurent Romary Connect in order to contact the contributor
Submitted on : Tuesday, November 27, 2012 - 9:04:13 AM
Last modification on : Friday, February 4, 2022 - 3:17:30 AM
Long-term archiving on: : Thursday, February 28, 2013 - 3:42:24 AM


Files produced by the author(s)


  • HAL Id : hal-00757452, version 1



Bertrand Gaiffe, Laurent Romary. Constraints on the Use of Language, Gesture and Speech for Multimodal Dialogues. Constraints On The Use Of Language Gesture And Speech For Multimodal Dialogues, ACL Special Interest Group on Multimedia Language Processing (SIGMEDIA), Jul 1997, Madrid, Spain. pp.94-98. ⟨hal-00757452⟩



Record views


Files downloads