Vision-based Force Feedback Estimation for Robot-assisted Surgery using Instrument-constrained Biomechanical 3D Maps

Abstract : We present a method for estimating visual and haptic force feedback on robotic surgical systems that currently do not include significant force feedback for the operator. Our approach permits to compute contact forces between instruments and tissues without additional sensors, relying only on endoscopic images acquired by a stereoscopic camera. Using an underlying biomechanical model built on-the-fly from the organ shape and by considering the surgical tool as boundary conditions acting on the surface of the model, contact force can be estimated at the tip of the tool. At the same time these constraints generate stresses that permit to compose a new endoscopic image as visual feedback for the surgeon. The results are demonstrated on in- vivo sequences of a human liver during robotic surgery, while quantitative validation is performed on an DejaVu and ex-vivo experimentation with ground truth to show the advantage of our approach.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [24 references]  Display  Hide  Download


https://hal.inria.fr/hal-01720259
Contributor : Nazim Haouchine <>
Submitted on : Thursday, March 1, 2018 - 1:10:11 AM
Last modification on : Friday, March 2, 2018 - 8:27:52 AM
Document(s) archivé(s) le : Wednesday, May 30, 2018 - 12:20:33 PM

Files

17-0884_06_MS.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Nazim Haouchine, Winnie Kuang, Stéphane Cotin, Michael Yip. Vision-based Force Feedback Estimation for Robot-assisted Surgery using Instrument-constrained Biomechanical 3D Maps. IEEE Robotics and Automation Letters, IEEE 2018, ⟨10.1109/LRA.2018.2810948⟩. ⟨hal-01720259⟩

Share

Metrics

Record views

522

Files downloads

653