Data-Driven 3D Reconstruction of Dressed Humans From Sparse Views - Archive ouverte HAL Access content directly
Conference Papers Year :

Data-Driven 3D Reconstruction of Dressed Humans From Sparse Views

(1) , (2) , (1) , (1) , (2)
1
2

Abstract

Recently, data-driven single-view reconstruction methods have shown great progress in modeling 3D dressed humans. However, such methods suffer heavily from depth ambiguities and occlusions inherent to single view inputs. In this paper, we tackle this problem by considering a small set of input views and investigate the best strategy to suitably exploit information from these views. We propose a data-driven end-to-end approach that reconstructs an implicit 3D representation of dressed humans from sparse camera views. Specifically, we introduce three key components: first a spatially consistent reconstruction that allows for arbitrary placement of the person in the input views using a perspective camera model; second an attention-based fusion layer that learns to aggregate visual information from several viewpoints; and third a mechanism that encodes local 3D patterns under the multi-view context. In the experiments, we show the proposed approach outperforms the state of the art on standard data both quantitatively and qualitatively. To demonstrate the spatially consistent reconstruction, we apply our approach to dynamic scenes. Additionally, we apply our method on real data acquired with a multi-camera platform and demonstrate our approach can obtain results comparable to multi-view stereo with dramatically less views.
Fichier principal
Vignette du fichier
3DV2021_pz.pdf (39.41 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03385107 , version 1 (19-10-2021)
hal-03385107 , version 2 (24-11-2021)
hal-03385107 , version 3 (05-12-2021)

Identifiers

Cite

Pierre Zins, Yuanlu Xu, Edmond Boyer, Stefanie Wuhrer, Tony Tung. Data-Driven 3D Reconstruction of Dressed Humans From Sparse Views. 3DV 2021 - International Conference on 3D Vision, Dec 2021, London, United Kingdom. ⟨hal-03385107v3⟩
231 View
39 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More