Reference resolution as a facilitating process towards robust multimodal dialogue management: A cognitive grammar approach

Abstract : This paper tries to fit a novel reference resolution mechanism into a multimodal dialogue system framework. Essentially, our aim is to show that a typical multimodal dialogue system can actually benefit from the cognitive grammar approach that we adopt for reference resolution. The central idea is to construct and update reference and context models in a manner that imparts adequate level of under-specificity to multimodal semantics. Context-independent semantic repre-sentations are constructed based upon the surface structure of the referring expressions and syntactic constraints within an utterance. The reference resolution algorithm assimilates these semantic representations into a coherent context model, resulting in the profiling of the intended referent. The resolution model is built upon discursive, perceptual and conceptual cues, thus successfully accounting for multiple modalities and a multi-dimensional application domain model.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [31 references]  Display  Hide  Download

https://hal.inria.fr/hal-01302287
Contributor : Laurent Romary <>
Submitted on : Thursday, April 14, 2016 - 12:18:42 PM
Last modification on : Friday, March 22, 2019 - 2:22:12 PM

File

ISSR-Alt-Kumar-Romary.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

  • HAL Id : hal-01302287, version 2

Collections

Citation

Ashwani Kumar, Susanne Salmon-Alt, Laurent Romary. Reference resolution as a facilitating process towards robust multimodal dialogue management: A cognitive grammar approach. International Symposium on Reference Resolution and Its Application to Question Answering and Summarization., Jun 2003, Venice, Italy. ⟨hal-01302287v2⟩

Share

Metrics

Record views

301

Files downloads

142