Visual Tracking of Deforming Objects Using Physics-based Models - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Visual Tracking of Deforming Objects Using Physics-based Models

Résumé

In this paper, we propose a framework for tracking the deformation of soft objects using a RGB-D camera by utilizing the physically-based model of the considered object. A coarse, 3D template of the object being tracked is the only prior information required by the proposed method. The proposed approach does not rely on the accurate knowledge of the material properties of the object being tracked. In this paper, we integrate computer vision based tracking methodology with physical model based deformation representation without requiring expensive numerical optimization for minimizing nonlinear error terms. The proposed approach enables deformation tracking by joint minimization of a geometric error and a direct photometric intensity error while utilizing co-rotational Finite Element Method (FEM) as the underlying deformation model. The proposed method has been validated both on synthetic data (with groundtruth) and real data.
Fichier principal
Vignette du fichier
ICRA21__home_papercept_ras.papercept.net_www_conferences_conferences_ICRA21_submissions_0894_FI.pdf (5.02 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03179253 , version 1 (24-03-2021)

Identifiants

  • HAL Id : hal-03179253 , version 1

Citer

Agniva Sengupta, Alexandre Krupa, Eric Marchand. Visual Tracking of Deforming Objects Using Physics-based Models. ICRA 2021 - IEEE International Conference on Robotics and Automation, May 2021, Xi'an, China. pp.14178-14184. ⟨hal-03179253⟩
189 Consultations
899 Téléchargements

Partager

Gmail Facebook X LinkedIn More