Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens

Abstract : Augmented Reality (AR) enriches our physical world with digital content and media, such as 3D models and videos, overlaying in real time the camera view of our smartphone, tablet, laptop, or glasses. Despite the recent massive interest for this technology, it is still not possible to receive rich haptic feedback when interacting with augmented environments. This lack is mainly due to the poor diffusion of suitable haptic interfaces, which should be easy to wear, lightweight, compact, and inexpensive. In this paper, we briefly review the state of the art on wearable haptics and its application in AR. Then, we present three AR use cases, considering tasks of manipulation, guidance, and gaming, using both external cameras with standard screens as well as fully-wearable solutions, using the Microsoft HoloLens. We evaluate these tasks enrolling a total of 34 subjects, analyzing performance and user experience when using a 3-DoF wearable device for the fingertip, a 2-DoF wearable device for the proximal finger phalanx, a vibrotactile ring, and a popular sensory substitution technique (interaction force displayed as a colored bar). Results show that providing haptic feedback through the wearable devices significantly improves the performance , intuitiveness, and comfort of the considered AR tasks.
Document type :
Journal articles
Complete list of metadatas

Cited literature [28 references]  Display  Hide  Download

https://hal.inria.fr/hal-01851705
Contributor : Claudio Pacchierotti <>
Submitted on : Monday, July 30, 2018 - 4:33:48 PM
Last modification on : Wednesday, January 22, 2020 - 7:44:02 PM

Identifiers

Citation

Leonardo Meli, Claudio Pacchierotti, Gionata Salvietti, Francesco Chinello, Maurizio Maisto, et al.. Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens. IEEE Robotics and Automation Letters, IEEE 2018, 3 (4), pp.4297-4304. ⟨10.1109/LRA.2018.2864354⟩. ⟨hal-01851705⟩

Share

Metrics

Record views

866

Files downloads

623