Model-based 3-D pose estimation and feature tracking for robot assisted surgery with medical imaging

C. Doignon 1 F. Nageotte 1 B. Maurin 1 A. Krupa 2
2 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : In this paper we address the problem of the pose estimation based on multiple geometrical features for monocular endoscopic vision with laparoscopes and for stereotaxy with CT scanners. Partial and full pose estimation (6 dofs) are considered with applications to minimally invasive surgery. At the University of Strasbourg, we have been developing a set of techniques for assisting surgeons in navigating and manipulating the three-dimensional space within the human body. In order to develop such systems, a variety of challenging visual tracking and registration problems with pre-operative and/or intra-operative images must be solved. This paper integrates several issues where computational vision can play a role. Depth recovery (from the tip of a surgical instrument w.r.t. living tissue), the Pl ¨ucker coordinates (4 dofs) of a markerless cylindrical instrument, the 6 dofs of a needle-holder with an heterogeneous set of features and stereotaxy are the examples we describe. Projective invariants with perspective projection, quadrics of revolution and stereotactic markers are features which are useful to achieve the registration with uncalibrated or calibrated devices. Visual servoing-based tracking methods have been developed for image-guided robotic systems, for assisting surgeons in laparoscopic surgery and in interventional radiology. Real-time endoscopic vision and single-slice stereotactic registration has been proposed to retrieve the out-of-field of view instruments, to position a needle and to compensate small displacements like those due to patient breathing or any small disturbances which may occur during an image-guided surgical procedure.
Type de document :
Communication dans un congrès
Kragic, D. From Features to Actions - Unifying Perspectives in Computational and Robot Vision, Workshop at the IEEE Int. Conf. on Robotics and Automation, 2007, Roma, Italy, France. 2007
Liste complète des métadonnées

Littérature citée [42 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00350647
Contributeur : Eric Marchand <>
Soumis le : mercredi 7 janvier 2009 - 14:27:04
Dernière modification le : mercredi 11 avril 2018 - 01:57:06
Document(s) archivé(s) le : mardi 8 juin 2010 - 18:55:04

Fichier

2007_wkicra_doignon.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00350647, version 1

Citation

C. Doignon, F. Nageotte, B. Maurin, A. Krupa. Model-based 3-D pose estimation and feature tracking for robot assisted surgery with medical imaging. Kragic, D. From Features to Actions - Unifying Perspectives in Computational and Robot Vision, Workshop at the IEEE Int. Conf. on Robotics and Automation, 2007, Roma, Italy, France. 2007. 〈inria-00350647〉

Partager

Métriques

Consultations de la notice

430

Téléchargements de fichiers

370