Constraints on the Use of Language, Gesture and Speech for Multimodal Dialogues

Bertrand Gaiffe 1 Laurent Romary 1
1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : We try to show how language, gesture and perception can be seen in a uniform way from the perspective of referential analysis, by looking at the specific constraints which underly the speaker's choice of a given expression. To this end, we first situate the relative importance of speech and gesture in man-machine communication. Then, we concentrate upon the specific effects resulting from the combination of verbal, gestural and perceptual information, showing that on the one hand the three provide structural constraints to the objects which are being referred to and on the other hand that any referring operation, whatever its origin, has to be interpreted within a localized frame, with some consequences upon dialogue management.
Document type :
Conference papers
Complete list of metadatas

Cited literature [4 references]  Display  Hide  Download

https://hal.inria.fr/hal-00757452
Contributor : Laurent Romary <>
Submitted on : Tuesday, November 27, 2012 - 9:04:13 AM
Last modification on : Friday, March 22, 2019 - 2:22:12 PM
Long-term archiving on : Thursday, February 28, 2013 - 3:42:24 AM

File

W97-1413.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00757452, version 1

Collections

Citation

Bertrand Gaiffe, Laurent Romary. Constraints on the Use of Language, Gesture and Speech for Multimodal Dialogues. Constraints On The Use Of Language Gesture And Speech For Multimodal Dialogues, ACL Special Interest Group on Multimedia Language Processing (SIGMEDIA), Jul 1997, Madrid, Spain. pp.94-98. ⟨hal-00757452⟩

Share

Metrics

Record views

400

Files downloads

131