Vision-based Force Feedback Estimation for Robot-assisted Surgery using Instrument-constrained Biomechanical 3D Maps - Archive ouverte HAL Access content directly
Journal Articles IEEE Robotics and Automation Letters Year : 2018

Vision-based Force Feedback Estimation for Robot-assisted Surgery using Instrument-constrained Biomechanical 3D Maps

(1) , (2) , (1) , (2)
1
2

Abstract

We present a method for estimating visual and haptic force feedback on robotic surgical systems that currently do not include significant force feedback for the operator. Our approach permits to compute contact forces between instruments and tissues without additional sensors, relying only on endoscopic images acquired by a stereoscopic camera. Using an underlying biomechanical model built on-the-fly from the organ shape and by considering the surgical tool as boundary conditions acting on the surface of the model, contact force can be estimated at the tip of the tool. At the same time these constraints generate stresses that permit to compose a new endoscopic image as visual feedback for the surgeon. The results are demonstrated on in- vivo sequences of a human liver during robotic surgery, while quantitative validation is performed on an DejaVu and ex-vivo experimentation with ground truth to show the advantage of our approach.
Fichier principal
Vignette du fichier
17-0884_06_MS.pdf (3.21 Mo) Télécharger le fichier
Vignette du fichier
Screen Shot 2018-03-01 at 1.07.58 AM.png (165.42 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image
Loading...

Dates and versions

hal-01720259 , version 1 (01-03-2018)

Identifiers

Cite

Nazim Haouchine, Winnie Kuang, Stéphane Cotin, Michael Yip. Vision-based Force Feedback Estimation for Robot-assisted Surgery using Instrument-constrained Biomechanical 3D Maps. IEEE Robotics and Automation Letters, 2018, ⟨10.1109/LRA.2018.2810948⟩. ⟨hal-01720259⟩

Collections

INRIA SOFA INRIA2
575 View
784 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More