Skip to Main content Skip to Navigation
Conference papers

Learning to Track 3D Human Motion from Silhouettes

Ankur Agarwal 1 Bill Triggs 1
1 LEAR - Learning and recognition in vision
GRAVIR - IMAG - Laboratoire d'informatique GRAphique, VIsion et Robotique de Grenoble, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : This paper describes a sparse Bayesian regression method for recovering 3D human body motion directly from silhouettes extracted from monocular video sequences. No detailed body shape model is needed, and realism is ensured by training on real human motion capture data. The tracker estimates 3D body pose by using Relevance Vector Machine regression to combine a learned autoregressive dynamical model with robust shape descriptors extracted automatically from image silhouettes. We studied several different combination methods, the most effective being to learn a nonlinear observation-update correction based on joint regression with respect to the predicted state and the observations. We demonstrate the method on a 54-parameter full body pose model, both quantitatively using motion capture based test sequences, and qualitatively on a test video sequence.
Document type :
Conference papers
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download


https://hal.inria.fr/inria-00548549
Contributor : Thoth Team <>
Submitted on : Monday, December 20, 2010 - 9:09:38 AM
Last modification on : Monday, December 28, 2020 - 3:44:02 PM
Long-term archiving on: : Monday, March 21, 2011 - 3:15:27 AM

Identifiers

Collections

IMAG | CNRS | INRIA | UGA

Citation

Ankur Agarwal, Bill Triggs. Learning to Track 3D Human Motion from Silhouettes. 21st International Conference on Machine Learning (ICML '04), Jul 2004, Banff, Canada. pp.9--16, ⟨10.1145/1015330.1015343⟩. ⟨inria-00548549⟩

Share

Metrics

Record views

392

Files downloads

928