Skip to Main content Skip to Navigation
Journal articles

A Visual Approach to Measure Cloth-Body and Cloth-Cloth Friction

Abdullah-Haroon Rasheed 1, 2 Victor Romero 2, 3 Florence Bertails-Descoubes 2 Stefanie Wuhrer 1 Jean-Sébastien Franco 1 Arnaud Lazarus 3 
1 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
2 ELAN - ModELisation de l'apparence des phénomènes Non-linéaires
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann
Abstract : Measuring contact friction in soft-bodies usually requires a specialised physics bench and a tedious acquisition protocol. This makes the prospect of a purely non-invasive, video-based measurement technique particularly attractive. Previous works have shown that such a video-based estimation is feasible for material parameters using deep learning, but this has never been applied to the friction estimation problem which results in even more subtle visual variations. Because acquiring a large dataset for this problem is impractical, generating it from simulation is the obvious alternative. However, this requires the use of a frictional contact simulator whose results are not only visually plausible, but physically-correct enough to match observations made at the macroscopic scale. In this paper, which is an extended version of our former work [31], we propose to our knowledge the first non-invasive measurement network and adjoining synthetic training dataset for estimating cloth friction at contact, for both cloth-hard body and cloth-cloth contacts. To this end we build a protocol for validating and calibrating a state-of-the-art frictional contact simulator, in order to produce a reliable dataset. We furthermore show that without our careful calibration procedure, the training fails to provide accurate estimation results on real data. We present extensive results on a large acquired test set of several hundred real video sequences of cloth in friction, which validates the proposed protocol and its accuracy.
Complete list of metadata
Contributor : Abdullah Rasheed Connect in order to contact the contributor
Submitted on : Tuesday, July 13, 2021 - 2:46:31 PM
Last modification on : Friday, April 1, 2022 - 3:45:50 AM
Long-term archiving on: : Thursday, October 14, 2021 - 7:26:30 PM



Abdullah-Haroon Rasheed, Victor Romero, Florence Bertails-Descoubes, Stefanie Wuhrer, Jean-Sébastien Franco, et al.. A Visual Approach to Measure Cloth-Body and Cloth-Cloth Friction. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, In press, ⟨10.1109/TPAMI.2021.3097547⟩. ⟨hal-03285624⟩



Record views


Files downloads