Fitting a 3D Morphable Model to Edges: A Comparison Between Hard and Soft Correspondences

Abstract : In this paper we explore the problem of fitting a 3D morphable model to single face images using only sparse geometric features (edges and landmark points). Previous approaches to this problem are based on nonlinear optimisation of an edge-derived cost that can be viewed as forming soft correspondences between model and image edges. We propose a novel approach, that explicitly computes hard correspondences. The resulting objective function is non-convex but we show that a good initialisation can be obtained efficiently using alternating linear least squares in a manner similar to the iterated closest point algorithm. We present experimental results on both synthetic and real images and show that our approach outperforms methods that use soft correspondence and other recent methods that rely solely on geometric features.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [33 references]  Display  Hide  Download

https://hal.inria.fr/hal-01271343
Contributor : Stefanie Wuhrer <>
Submitted on : Friday, October 7, 2016 - 9:46:32 AM
Last modification on : Wednesday, April 11, 2018 - 1:58:45 AM
Document(s) archivé(s) le : Sunday, January 8, 2017 - 12:25:52 PM

File

bas_etal_2016.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Anil Bas, William A. P. Smith, Timo Bolkart, Stefanie Wuhrer. Fitting a 3D Morphable Model to Edges: A Comparison Between Hard and Soft Correspondences. Asian Conference on Computer Vision Workshop on Facial Informatics, Nov 2016, Taipei, Taiwan. pp.377-391, ⟨10.1007/978-3-319-54427-4_28⟩. ⟨hal-01271343v2⟩

Share

Metrics

Record views

533

Files downloads

1800