Capturing Deformations of Interacting Non-rigid Objects Using RGB-D Data

Abstract : This paper presents a method for tracking multiple interacting deformable objects undergoing rigid motions, elastic deformations and contacts, using image and point cloud data provided by an RGB-D sensor. A joint registration framework is proposed, based on physical Finite Element Method (FEM) elastic and interaction models. It first relies on a visual segmentation of the considered objects in the RGB images. The different segmented point clouds are then processed to estimate rigid transformations with on an ICP algorithm, and to determine geometrical point-to-point correspondences with the meshes. External forces resulting from these correspondences and between the current and the rigidly transformed mesh can then be derived. It provides both non-rigid and rigid data cues. A classical collision detection and response model is also integrated, giving contact forces between the objects. The deformations of the objects are estimated by solving a dynamic system balancing these external and contact forces with the internal or regularization forces computed through the FEM elastic model. This approach has been here tested on different scenarios involving two or three interacting deformable objects of various shapes, with promising results.
Type de document :
Communication dans un congrès
IROS 2018 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct 2018, Madrid, Spain. 〈https://www.iros2018.org/〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01889771
Contributeur : Antoine Petit <>
Soumis le : lundi 8 octobre 2018 - 01:06:50
Dernière modification le : mercredi 24 octobre 2018 - 15:46:09

Fichier

iros2018_apetit_2.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01889771, version 1

Collections

Citation

Antoine Petit, Stéphane Cotin, Vincenzo Lippiello, Bruno Siciliano. Capturing Deformations of Interacting Non-rigid Objects Using RGB-D Data. IROS 2018 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct 2018, Madrid, Spain. 〈https://www.iros2018.org/〉. 〈hal-01889771〉

Partager

Métriques

Consultations de la notice

122

Téléchargements de fichiers

123