Skip to Main content Skip to Navigation
Conference papers

Towards Multimodal Content Representation

Harry Bunt Laurent Romary 1
1 LANGUE ET DIALOGUE - Human-machine dialogue with a significant language component
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Multimodal interfaces, combining the use of speech, graphics, gestures, and facial expressions in input and output, promise to provide new possibilities to deal with information in more effective and efficient ways, supporting for instance: - the understanding of possibly imprecise, partial or ambiguous multimodal input; - the generation of coordinated, cohesive, and coherent multimodal presentations; - the management of multimodal interaction (e.g., task completion, adapting the interface, error prevention) by representing and exploiting models of the user, the domain, the task, the interactive context, and the media (e.g. text, audio, video). The present document is intended to support the discussion on multimodal content representation, its possible objectives and basic constraints, and how the definition of a generic representation framework for multimodal content representation may be approached. It takes into account the results of the Dagstuhl workshop, in particular those of the informal working group on multimodal meaning representation that was active during the workshop (see, Working Group 4).
Document type :
Conference papers
Complete list of metadata

Cited literature [11 references]  Display  Hide  Download
Contributor : Laurent Romary Connect in order to contact the contributor
Submitted on : Wednesday, September 23, 2009 - 8:09:17 PM
Last modification on : Thursday, October 28, 2021 - 9:42:01 AM
Long-term archiving on: : Friday, November 25, 2016 - 12:04:06 PM


  • HAL Id : inria-00100772, version 1
  • ARXIV : 0909.4280



Harry Bunt, Laurent Romary. Towards Multimodal Content Representation. LREC Workshop on International Standards of Terminology and Language Resources Management, May 2002, Las Palams, Spain. 7 p. ⟨inria-00100772⟩



Record views


Files downloads