Shape correspondences from learnt template-based parametrization

Résumé : We present a new deep learning approach for matching deformable shapes by using a model which jointly encodes 3D shapes and correspondences. This is achieved by factoring the surface representation into (i) a template, that parameterizes the surface, and (ii) a learnt feature vector that parameterizes the function which transforms the template into the input surface. We show that our network can directly predict the feature vector and thus correspondences for a new input shape, but also that correspondence quality can be significantly improved by an additional regression step. This additional step improves the shape feature vector by minimizing the Chamfer distance between the input and parameterized shape. We show that this produces both a better shape representation and better correspondences. We demonstrate that our simple approach improves state of the art results on the difficult FAUST inter challenge, with an average correspondence error of 2.88cm. We also show results on the real scans from the SCAPE dataset and the synthetically perturbed shapes from the TOSCA dataset, including non-human shapes.
Complete list of metadatas

Cited literature [48 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01830474
Contributor : Thibault Groueix <>
Submitted on : Monday, July 16, 2018 - 4:55:01 PM
Last modification on : Tuesday, March 5, 2019 - 2:40:07 PM
Long-term archiving on : Monday, October 1, 2018 - 4:03:43 PM

File

1806.05228.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01830474, version 1
  • ARXIV : 1806.05228

Collections

Citation

Thibault Groueix, Matthew Fisher, Vladimir Kim, Bryan Russell, Mathieu Aubry. Shape correspondences from learnt template-based parametrization. 15th European Conference on Computer Vision ECCV 2018, Sep 2018, Munich, Germany. ⟨hal-01830474v1⟩

Share

Metrics

Record views

198

Files downloads

149