Vision-Based Sensing of External Forces Acting on Soft Robots Using Finite Element Method

Zhongkai Zhang 1 Jérémie Dequidt 1 Christian Duriez 1
1 DEFROST - Deformable Robots Simulation Team
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : In this paper, we propose a new framework of external force sensing for soft robots based on the fusion of vision-based measurements and Finite Element Model (FEM) techniques. A precise mechanical model of the robot is built using real-time FEM to describe the relationship between the external forces acting on the robot and the displacement of predefined feature points. The position of these feature points on the real robot is measured using a vision system and is compared with the equivalent feature points in the finite element model. Using the compared displacement, the intensities of the external forces are computed by solving an inverse problem. Based on the developed FEM equations, we show that not only the intensities but also the locations of the external forces can be estimated. A strategy is proposed to find the correct locations of external forces among several possible ones. The method is verified and validated using both simulation and experiments on a soft sheet and a parallel soft robot (both of them have non-trivial shapes). The good results obtained from the experimental study demonstrate the capability of our approach.
Document type :
Journal articles
Complete list of metadatas

Cited literature [25 references]  Display  Hide  Download
Contributor : Zhongkai Zhang <>
Submitted on : Thursday, March 1, 2018 - 2:28:11 PM
Last modification on : Friday, March 22, 2019 - 1:36:28 AM
Long-term archiving on : Wednesday, May 30, 2018 - 1:41:39 PM


Vision-Based Sensing of Extern...
Files produced by the author(s)



Zhongkai Zhang, Jérémie Dequidt, Christian Duriez. Vision-Based Sensing of External Forces Acting on Soft Robots Using Finite Element Method. IEEE Robotics and Automation Letters, IEEE 2018, 3 (3), pp.1529 - 1536. ⟨10.1109/LRA.2018.2800781⟩. ⟨hal-01720645⟩



Record views


Files downloads