Depth-based hand pose estimation: data, methods, and challenges

James Supancic 1 Gregory Rogez 2 Yi Yang 3 Jamie Shotton 4 Deva Ramanan 5
1 UCI - University of California [Irvine]
2 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
3 Baidu Research
4 Microsoft - Microsoft Research [Cambridge]
5 CMU - Carnegie Mellon University [Pittsburgh]
Abstract : Hand pose estimation has matured rapidly in recent years. The introduction of commodity depth sensors and a multitude of practical applications have spurred new advances. We provide an extensive analysis of the state-of-the-art, focusing on hand pose estimation from a single depth frame. To do so, we have implemented a considerable number of systems, and will release all software and evaluation code. We summarize important conclusions here: (1) Pose estimation appears roughly solved for scenes with isolated hands. However, methods still struggle to analyze cluttered scenes where hands may be interacting with nearby objects and surfaces. To spur further progress we introduce a challenging new dataset with diverse, cluttered scenes. (2) Many methods evaluate themselves with disparate criteria , making comparisons difficult. We define a consistent evaluation criteria, rigorously motivated by human experiments. (3) We introduce a simple nearest-neighbor baseline that outperforms most existing systems. This implies that most systems do not generalize beyond their training sets. This also reinforces the under-appreciated point that training data is as important as the model itself. We conclude with directions for future progress.
Type de document :
Communication dans un congrès
ICCV - IEEE International Conference on Computer Vision, Dec 2015, Santiago, Chile. IEEE, pp.1868-1876, 〈http://pamitc.org/iccv15/〉. 〈10.1109/ICCV.2015.217〉
Liste complète des métadonnées

Littérature citée [37 références]  Voir  Masquer  Télécharger

screenshot_handEval.jpg
screenshot_handEval.jpg
https://hal.inria.fr/hal-01237023
Contributeur : Gregory Rogez <>
Soumis le : mercredi 2 décembre 2015 - 15:29:14
Dernière modification le : vendredi 27 juillet 2018 - 11:41:04
Document(s) archivé(s) le : samedi 29 avril 2017 - 03:45:06

Fichiers

HandEval.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

INRIA | LJK | UGA | LJK_GI | LJK_GI_LEAR

Citation

James Supancic, Gregory Rogez, Yi Yang, Jamie Shotton, Deva Ramanan. Depth-based hand pose estimation: data, methods, and challenges. ICCV - IEEE International Conference on Computer Vision, Dec 2015, Santiago, Chile. IEEE, pp.1868-1876, 〈http://pamitc.org/iccv15/〉. 〈10.1109/ICCV.2015.217〉. 〈hal-01237023〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

8661

Téléchargements de fichiers

330

Contact


archive-ouverte@inria.fr