Skip to Main content Skip to Navigation
Conference papers

Tracking of Non-Rigid Objects using RGB-D Camera

Agniva Sengupta 1 Alexandre Krupa 1 Eric Marchand 1
1 RAINBOW - Sensor-based and interactive robotics
Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : A method to accurately track deformable objects using a RGB-D camera with the help of a coarse object model is presented in this paper. The deformation model is based on corotational FEM formulation. The physical model of the object does not need to be exact, nor do we require the precise physical properties for accurately tracking the object. The position of the vertices of the surface mesh of the tracked object is deformed using a set of virtual forces. A point-to-plane distance based geometric error between the pointcloud and the mesh is minimized with respect to these virtual forces. The point of application of force is determined by analysis of the error obtained from rigid tracking, which is done in parallel with the non-rigid tracking. This architecture also enables the overall system to be realtime. The proposed approach is evaluated on a synthetic data with ground-truth for deformation at every frame, as well as on real data.
Document type :
Conference papers
Complete list of metadatas

Cited literature [32 references]  Display  Hide  Download

https://hal.inria.fr/hal-02178353
Contributor : Eric Marchand <>
Submitted on : Thursday, August 8, 2019 - 12:11:05 PM
Last modification on : Wednesday, June 24, 2020 - 4:19:53 PM

File

SMC19_0740_FI.pdf
Files produced by the author(s)

Identifiers

Citation

Agniva Sengupta, Alexandre Krupa, Eric Marchand. Tracking of Non-Rigid Objects using RGB-D Camera. SMC 2019 - IEEE International Conference on Systems, Man, and Cybernetics, Oct 2019, Bari, Italy. pp.3310-3317, ⟨10.1109/SMC.2019.8914543⟩. ⟨hal-02178353v2⟩

Share

Metrics

Record views

102

Files downloads

902