Towards Multimodal Content Representation

Harry Bunt Laurent Romary 1
1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Multimodal interfaces, combining the use of speech, graphics, gestures, and facial expressions in input and output, promise to provide new possibilities to deal with information in more effective and efficient ways, supporting for instance: - the understanding of possibly imprecise, partial or ambiguous multimodal input; - the generation of coordinated, cohesive, and coherent multimodal presentations; - the management of multimodal interaction (e.g., task completion, adapting the interface, error prevention) by representing and exploiting models of the user, the domain, the task, the interactive context, and the media (e.g. text, audio, video). The present document is intended to support the discussion on multimodal content representation, its possible objectives and basic constraints, and how the definition of a generic representation framework for multimodal content representation may be approached. It takes into account the results of the Dagstuhl workshop, in particular those of the informal working group on multimodal meaning representation that was active during the workshop (see http://www.dfki.de/~wahlster/Dagstuhl_Multi_Modality, Working Group 4).
Document type :
Conference papers
Complete list of metadatas

Cited literature [11 references]  Display  Hide  Download

https://hal.inria.fr/inria-00100772
Contributor : Laurent Romary <>
Submitted on : Wednesday, September 23, 2009 - 8:09:17 PM
Last modification on : Monday, April 8, 2019 - 10:24:04 AM
Long-term archiving on : Friday, November 25, 2016 - 12:04:06 PM

Identifiers

  • HAL Id : inria-00100772, version 1
  • ARXIV : 0909.4280

Collections

Citation

Harry Bunt, Laurent Romary. Towards Multimodal Content Representation. LREC Workshop on International Standards of Terminology and Language Resources Management, May 2002, Las Palams, Spain. 7 p. ⟨inria-00100772⟩

Share

Metrics

Record views

303

Files downloads

174