Skip to Main content Skip to Navigation
Journal articles

Intensity-based Visual Servoing for Instrument and Tissue Tracking in 3D Ultrasound Volumes

Caroline Nadeau 1 Hongliang Ren 2 Alexandre Krupa 1 Pierre Dupont 2
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : This paper presents a three dimensional ultrasound (3DUS)-based visual servoing technique for intraoperative track- ing of the motion of both surgical instruments and tissue targets. In the proposed approach, visual servoing techniques are used to control the position of a virtual ultrasound probe so as to keep a target centered within the virtual probe's field of view. Multiple virtual probes can be servoed in parallel to provide simultaneous tracking of instruments and tissue. The technique is developed in the context of robotic beating-heart intracardiac surgery in which the goal of tracking is to both provide guidance to the operator as well as to provide the means to automate the surgical procedure. To deal with the low signal-to-noise ratio (SNR) of the 3DUS volumes, an intensity-based method is proposed that requires no primitive extraction or image segmentation since it directly utilizes the image intensity information as a visual feature. This approach is computationally efficient and can be applied to a wide range of tissue types and medical instruments. This paper presents the first validation of these techniques through off-line robot and tissue tracking using actual in vivo cardiac volume sequences from a robotic beating-heart surgery.
Document type :
Journal articles
Complete list of metadata

Cited literature [22 references]  Display  Hide  Download

https://hal.inria.fr/hal-01071247
Contributor : Eric Marchand <>
Submitted on : Friday, October 3, 2014 - 3:04:06 PM
Last modification on : Friday, July 10, 2020 - 4:14:57 PM
Long-term archiving on: : Sunday, January 4, 2015 - 10:46:18 AM

File

TASE.pdf
Files produced by the author(s)

Identifiers

Citation

Caroline Nadeau, Hongliang Ren, Alexandre Krupa, Pierre Dupont. Intensity-based Visual Servoing for Instrument and Tissue Tracking in 3D Ultrasound Volumes. IEEE Transactions on Automation Science and Engineering, Institute of Electrical and Electronics Engineers, 2015, 12 (1), pp.367-371. ⟨10.1109/TASE.2014.2343652⟩. ⟨hal-01071247⟩

Share

Metrics

Record views

628

Files downloads

626