Simultaneous Pose Estimation and Augmentation of Elastic Surfaces from a Moving Monocular Camera

Nazim Haouchine 1 Marie-Odile Berger 2 Stephane Cotin 1
2 MAGRIT - Visual Augmentation of Complex Environments
Inria Nancy - Grand Est, LORIA - ALGO - Department of Algorithms, Computation, Image and Geometry
Abstract : We present in this paper an original method to estimate the pose of a monocular camera while simultaneously modeling and capturing the elastic deformation of the object to be augmented. Our method tackles a challenging problem where ambiguities between rigid motion and non-rigid deformation are present. This issue represents a major lock for the establishment of an efficient surgical augmented reality where endoscopic camera moves and organs deform. Using an underlying physical model to estimate the low stressed regions our algorithm separates the rigid body motion from the elastic deformations using polar decomposition of the strain tensor. Following this decomposition, a constrained minimization, that encodes both the optical and the physical constraints, is resolved at each frame. Results on real and simulated data are exposed to show the effectiveness of our approach.
Document type :
Conference papers
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download


https://hal.inria.fr/hal-01353189
Contributor : Nazim Haouchine <>
Submitted on : Wednesday, August 10, 2016 - 4:30:27 PM
Last modification on : Tuesday, December 18, 2018 - 4:18:26 PM
Long-term archiving on : Friday, November 11, 2016 - 11:00:46 AM

Files

haouchine_ISMAR2016.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01353189, version 1

Collections

Citation

Nazim Haouchine, Marie-Odile Berger, Stephane Cotin. Simultaneous Pose Estimation and Augmentation of Elastic Surfaces from a Moving Monocular Camera. International Symposium on Mixed and Augmented Reality, Sep 2016, Merida, Mexico. ⟨hal-01353189⟩

Share

Metrics

Record views

604

Files downloads

678