Hand Motion from 3D Point Trajectories and a Smooth Surface Model

Guillaume Dewaele 1 Frédéric Devernay 1 Radu Horaud 1
1 MOVI - Modeling, localization, recognition and interpretation in computer vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : A method is proposed to track the full hand motion from 3D points reconstructed using a stereoscopic set of cameras. This approach combines the advantages of methods that use 2D motion (e.g. optical flow), and those that use a 3D reconstruction at each time frame to capture the hand motion. Matching either contours or a 3D reconstruction against a 3D hand model is usually very difficult due to self-occlusions and the locally-cylindrical structure of each phalanx in the model, but our use of 3D point trajectories constrains the motion and overcomes these problems. Our tracking procedure uses both the 3D point matches between two time frames and a smooth surface model of the hand, build with implicit surface. We used animation techniques to represent faithfully the skin motion, especially near joints. Robustness is obtained by using an EM version of the ICP algorithm for matching points between consecutive frames, and the tracked points are then registered to the surface of the hand model. Results are presented on a stereoscopic sequence of a moving hand, and are evaluated using a side view of the sequence.
Document type :
Conference papers
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download

https://hal.inria.fr/inria-00262293
Contributor : Frédéric Devernay <>
Submitted on : Tuesday, March 11, 2008 - 12:33:11 PM
Last modification on : Friday, June 1, 2018 - 1:02:03 PM
Long-term archiving on : Thursday, May 20, 2010 - 9:50:18 PM

File

hand3d.pdf
Publisher files allowed on an open archive

Identifiers

Collections

IMAG | INRIA | UGA

Citation

Guillaume Dewaele, Frédéric Devernay, Radu Horaud. Hand Motion from 3D Point Trajectories and a Smooth Surface Model. European Conference on Computer Vision, 2004, Prague, Czech Republic. pp.495-507, ⟨10.1007/978-3-540-24670-1_38⟩. ⟨inria-00262293⟩

Share

Metrics

Record views

599

Files downloads

598