Auxiliary Guided Autoregressive Variational Autoencoders

Thomas Lucas 1 Jakob Verbeek 1
1 Thoth - Apprentissage de modèles à partir de données massives
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann
Abstract : Generative modeling of high-dimensional data is a key problem in machine learning. Successful approaches include latent variable models and autoregressive models. The complementary strengths of these approaches, to model global and local image statistics respectively, suggest hybrid models combining the strengths of both models. Our contribution is to train such hybrid models using an auxiliary loss function that controls which information is captured by the latent variables and what is left to the autoregressive decoder. In contrast, prior work on such hybrid models needed to limit the capacity of the autoregressive decoder to prevent degenerate models that ignore the latent variables and only rely on autoregressive modeling. Our approach results in models with meaningful latent variable representations, and which rely on powerful autoregressive decoders to model image details. Our model generates qualitatively convincing samples, and yields state-of-the-art quantitative results.
Type de document :
Communication dans un congrès
ECML-PKDD 2018 - European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Sep 2018, Dublin, Ireland. Springer, Machine Learning and Knowledge Discovery in Databases, 11051, pp.443-458, Lecture Notes in Computer Science. 〈10.1007/978-3-030-10925-7_27〉
Liste complète des métadonnées

Littérature citée [9 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01652881
Contributeur : Thomas Lucas <>
Soumis le : jeudi 19 juillet 2018 - 16:36:30
Dernière modification le : jeudi 7 février 2019 - 16:31:54

Fichier

paper_ecml.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Thomas Lucas, Jakob Verbeek. Auxiliary Guided Autoregressive Variational Autoencoders. ECML-PKDD 2018 - European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Sep 2018, Dublin, Ireland. Springer, Machine Learning and Knowledge Discovery in Databases, 11051, pp.443-458, Lecture Notes in Computer Science. 〈10.1007/978-3-030-10925-7_27〉. 〈hal-01652881v2〉

Partager

Métriques

Consultations de la notice

441

Téléchargements de fichiers

210