Learning Dialogue Dynamics with the Method of Moments

Abstract : In this paper, we introduce a novel framework to encode the dynamics of dialogues into a probabilistic graphical model. Traditionally, Hidden Markov Models (HMMs) would be used to address this problem, involving a first step of hand-crafting to build a dialogue model (e.g. defining potential hidden states) followed by applying expectation-maximisation (EM) algorithms to refine it. Recently, an alternative class of algorithms based on the Method of Moments (MoM) has proven successful in avoiding issues of the EM-like algorithms such as convergence towards local optima, tractability issues, initialization issues or the lack of theoretical guarantees. In this work, we show that dialogues may be modeled by SP-RFA, a class of graphical models efficiently learnable within the MoM and directly usable in planning algorithms (such as reinforcement learning). Experiments are led on the Ubuntu corpus and dialogues are considered as sequences of dialogue acts, represented by their Latent Dirichlet Allocation (LDA) and Latent Semantic Analysis (LSA). We show that a MoM-based algorithm can learn a compact model of sequences of such acts.
Type de document :
Communication dans un congrès
Workshop on Spoken Language Technologie (SLT 2016), Dec 2016, San Diego, United States. 〈http://www.slt2016.org/〉
Liste complète des métadonnées

Littérature citée [37 références]  Voir  Masquer  Télécharger

Contributeur : Olivier Pietquin <>
Soumis le : jeudi 1 décembre 2016 - 16:39:51
Dernière modification le : vendredi 13 avril 2018 - 01:27:56
Document(s) archivé(s) le : mardi 21 mars 2017 - 03:32:44


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01406904, version 1



Merwan Barlier, Romain Laroche, Olivier Pietquin. Learning Dialogue Dynamics with the Method of Moments. Workshop on Spoken Language Technologie (SLT 2016), Dec 2016, San Diego, United States. 〈http://www.slt2016.org/〉. 〈hal-01406904〉



Consultations de la notice


Téléchargements de fichiers