Multimodal Image Registration and Visual Servoing

Mouloud Ourak 1 Brahim Tamadazte 1 Nicolas Andreff 1 Eric Marchand 2
2 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : This paper deals with multimodal imaging in the surgical robotics context. 1 On the first hand, it addresses numerical registration of a preoperative image obtained 2 by fluorescence with an intraoperative image grabbed by a conventional white-light 3 endoscope. This registration involves displacement and rotation in the image plane as 4 well as a scale factor. On the second hand, a method is developed to visually servo the 5 endoscope to the preoperative imaging location. Both methods are original and dually 6 based on the use of mutual information between a pair of fluorescence and white-light 7 images and of a modified Nelder-Mead simplex algorithm. Numerical registration is 8 validated on real images whereas visual servoing is validated experimentally in two 9 setups: a planar microrobotic platform and a 6DOF parallel robot.
Type de document :
Chapitre d'ouvrage
Lecture Notes in Electrical Engineering, 383, Springer, pp.157 - 175, 2016, 〈10.1007/978-3-319-31898-1_9〉
Liste complète des métadonnées

Littérature citée [13 références]  Voir  Masquer  Télécharger
Contributeur : Eric Marchand <>
Soumis le : vendredi 13 janvier 2017 - 10:26:27
Dernière modification le : vendredi 16 novembre 2018 - 01:38:06
Document(s) archivé(s) le : vendredi 14 avril 2017 - 17:01:02


Fichiers produits par l'(les) auteur(s)



Mouloud Ourak, Brahim Tamadazte, Nicolas Andreff, Eric Marchand. Multimodal Image Registration and Visual Servoing. Lecture Notes in Electrical Engineering, 383, Springer, pp.157 - 175, 2016, 〈10.1007/978-3-319-31898-1_9〉. 〈hal-01433996〉



Consultations de la notice


Téléchargements de fichiers