Vision-based adaptive assistance and haptic guidance for safe wheelchair corridor following

Vishnu Karakkat Narayanan 1 François Pasteau 1 Maud Marchal 2 Alexandre Krupa 1 Marie Babel 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
2 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : In case of motor impairments, steering a wheelchair can become a hazardous task. Joystick jerks induced by uncontrolled motions may lead to wall collisions when a user steers a wheelchair along a corridor. This work introduces a low-cost assistive and guidance system for indoor corridor navigation in a wheelchair, which uses purely visual information, and which is capable of providing automatic trajectory correction and haptic guidance in order to avoid wall collisions. A visual servoing approach to autonomous corridor following serves as the backbone to this system. The algorithm employs natural image features which can be robustly extracted in real time. This algorithm is then fused with manual joystick input from the user so that progressive assistance and trajectory correction can be activated as soon as the user is in danger of collision. A force feedback in conjunction with the assistance is provided on the joystick in order to guide the user out of his dangerous tra-jectory. This ensures intuitive guidance and minimal interference from the trajectory correction system. In addition to being a low-cost approach, it can be seen that the proposed solution does not require an a-priori environment model. Experiments on a robotised wheelchair equipped with a monocular camera prove the capability of the system to adaptively guide and assist a user navigating in a corridor.
Document type :
Journal articles
Complete list of metadatas

Cited literature [36 references]  Display  Hide  Download
Contributor : Eric Marchand <>
Submitted on : Monday, February 22, 2016 - 5:52:53 PM
Last modification on : Thursday, February 7, 2019 - 4:43:16 PM
Long-term archiving on : Monday, May 23, 2016 - 3:01:59 PM


Files produced by the author(s)


  • HAL Id : hal-01277585, version 1


Vishnu Karakkat Narayanan, François Pasteau, Maud Marchal, Alexandre Krupa, Marie Babel. Vision-based adaptive assistance and haptic guidance for safe wheelchair corridor following. Computer Vision and Image Understanding, Elsevier, 2016, 179, pp.171-185. ⟨hal-01277585⟩



Record views


Files downloads