Skip to Main content Skip to Navigation
Conference papers

Model-based 3-D pose estimation and feature tracking for robot assisted surgery with medical imaging

C. Doignon 1 F. Nageotte 1 B. Maurin 1 A. Krupa 2
2 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper we address the problem of the pose estimation based on multiple geometrical features for monocular endoscopic vision with laparoscopes and for stereotaxy with CT scanners. Partial and full pose estimation (6 dofs) are considered with applications to minimally invasive surgery. At the University of Strasbourg, we have been developing a set of techniques for assisting surgeons in navigating and manipulating the three-dimensional space within the human body. In order to develop such systems, a variety of challenging visual tracking and registration problems with pre-operative and/or intra-operative images must be solved. This paper integrates several issues where computational vision can play a role. Depth recovery (from the tip of a surgical instrument w.r.t. living tissue), the Pl ¨ucker coordinates (4 dofs) of a markerless cylindrical instrument, the 6 dofs of a needle-holder with an heterogeneous set of features and stereotaxy are the examples we describe. Projective invariants with perspective projection, quadrics of revolution and stereotactic markers are features which are useful to achieve the registration with uncalibrated or calibrated devices. Visual servoing-based tracking methods have been developed for image-guided robotic systems, for assisting surgeons in laparoscopic surgery and in interventional radiology. Real-time endoscopic vision and single-slice stereotactic registration has been proposed to retrieve the out-of-field of view instruments, to position a needle and to compensate small displacements like those due to patient breathing or any small disturbances which may occur during an image-guided surgical procedure.
Document type :
Conference papers
Complete list of metadata

Cited literature [42 references]  Display  Hide  Download

https://hal.inria.fr/inria-00350647
Contributor : Eric Marchand <>
Submitted on : Wednesday, January 7, 2009 - 2:27:04 PM
Last modification on : Wednesday, June 16, 2021 - 3:41:29 AM
Long-term archiving on: : Tuesday, June 8, 2010 - 6:55:04 PM

File

2007_wkicra_doignon.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00350647, version 1

Citation

C. Doignon, F. Nageotte, B. Maurin, A. Krupa. Model-based 3-D pose estimation and feature tracking for robot assisted surgery with medical imaging. From Features to Actions - Unifying Perspectives in Computational and Robot Vision, Workshop at the IEEE Int. Conf. on Robotics and Automation, 2007, Roma, Italy. ⟨inria-00350647⟩

Share

Metrics

Record views

567

Files downloads

486