Skip to Main content Skip to Navigation
Conference papers

Probabilistic Reconstruction Networks for 3D Shape Inference from a Single Image

Roman Klokov 1 Jakob Verbeek 1 Edmond Boyer 2
1 Thoth - Apprentissage de modèles à partir de données massives
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann
2 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology, LJK - Laboratoire Jean Kuntzmann
Abstract : We study end-to-end learning strategies for 3D shape inference from images, in particular from a single image. Several approaches in this direction have been investigated that explore different shape representations and suitable learning architectures. We focus instead on the underlying probabilistic mechanisms involved and contribute a more principled probabilistic inference-based reconstruction framework, which we coin Probabilistic Reconstruction Networks. This framework expresses image conditioned 3D shape inference through a family of latent variable models, and naturally decouples the choice of shape representations from the inference itself. Moreover, it suggests different options for the image conditioning and allows training in two regimes, using either Monte Carlo or variational approximation of the marginal likelihood. Using our Probabilistic Reconstruction Networks we obtain single image 3D reconstruction results that set a new state of the art on the ShapeNet dataset in terms of the intersection over union and earth mover’s distance evaluation metrics. Interestingly, we obtain these results using a basic voxel grid representation, improving over recent work based on finer point cloud or mesh based representations.
Complete list of metadata

Cited literature [45 references]  Display  Hide  Download
Contributor : Roman Klokov Connect in order to contact the contributor
Submitted on : Tuesday, August 20, 2019 - 11:42:11 PM
Last modification on : Wednesday, November 3, 2021 - 8:45:48 AM
Long-term archiving on: : Thursday, January 9, 2020 - 3:28:02 PM


Files produced by the author(s)


  • HAL Id : hal-02268466, version 1
  • ARXIV : 1908.07475


Roman Klokov, Jakob Verbeek, Edmond Boyer. Probabilistic Reconstruction Networks for 3D Shape Inference from a Single Image. BMVC 2019 - British Machine Vision Conference, Sep 2019, Cardiff, United Kingdom. pp.1-13. ⟨hal-02268466⟩



Les métriques sont temporairement indisponibles