LCR-Net: Localization-Classification-Regression for Human Pose

Abstract : We propose an end-to-end architecture for joint 2D and 3D human pose estimation in natural images. Key to our approach is the generation and scoring of a number of pose proposals per image, which allows us to predict 2D and 3D pose of multiple people simultaneously. Hence, our approach does not require an approximate localization of the humans for initialization. Our architecture, named LCR-Net, contains 3 main components: 1) the pose proposal generator that suggests potential poses at different locations in the image; 2) a classifier that scores the different pose proposals ; and 3) a regressor that refines pose proposals both in 2D and 3D. All three stages share the convolutional feature layers and are trained jointly. The final pose estimation is obtained by integrating over neighboring pose hypotheses , which is shown to improve over a standard non maximum suppression algorithm. Our approach significantly outperforms the state of the art in 3D pose estimation on Human3.6M, a controlled environment. Moreover, it shows promising results on real images for both single and multi-person subsets of the MPII 2D pose benchmark.
Type de document :
Communication dans un congrès
CVPR 2017 - IEEE Conference on Computer Vision & Pattern Recognition, Jun 2017, Honolulu, United States
Liste complète des métadonnées

Littérature citée [37 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-01505085
Contributeur : Gregory Rogez <>
Soumis le : vendredi 21 juillet 2017 - 22:52:27
Dernière modification le : vendredi 28 juillet 2017 - 15:02:22

Fichiers

cvpr_2017.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01505085, version 1

Collections

Citation

Gregory Rogez, Philippe Weinzaepfel, Cordelia Schmid. LCR-Net: Localization-Classification-Regression for Human Pose. CVPR 2017 - IEEE Conference on Computer Vision & Pattern Recognition, Jun 2017, Honolulu, United States. 〈hal-01505085〉

Partager

Métriques

Consultations de
la notice

1040

Téléchargements du document

1435