Reference resolution as a facilitating process towards robust multimodal dialogue management: A cognitive grammar approach

Abstract : This paper tries to fit a novel reference resolution mechanism into a multimodal dialogue system framework. Essentially, our aim is to show that a typical multimodal dialogue system can actually benefit from the cognitive grammar approach that we adopt for reference resolution. The central idea is to construct and update reference and context models in a manner that imparts adequate level of under-specificity to multimodal semantics. Context-independent semantic repre-sentations are constructed based upon the surface structure of the referring expressions and syntactic constraints within an utterance. The reference resolution algorithm assimilates these semantic representations into a coherent context model, resulting in the profiling of the intended referent. The resolution model is built upon discursive, perceptual and conceptual cues, thus successfully accounting for multiple modalities and a multi-dimensional application domain model.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/hal-01302287
Contributor : Laurent Romary <>
Submitted on : Wednesday, April 13, 2016 - 8:47:12 PM
Last modification on : Friday, March 22, 2019 - 2:22:12 PM
Long-term archiving on : Tuesday, November 15, 2016 - 2:49:21 AM

File

ISRR-Ashwani.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

  • HAL Id : hal-01302287, version 1

Citation

Ashwani Kumar, Susanne Salmon-Alt, Laurent Romary. Reference resolution as a facilitating process towards robust multimodal dialogue management: A cognitive grammar approach. International Symposium on Reference Resolution and Its Application to Question Answering and Summarization., Jun 2003, Venice, Italy. ⟨hal-01302287v1⟩

Share

Metrics

Record views

12

Files downloads

17