Personal Shopping Assistance and Navigator System for Visually Impaired People

Paul Chippendale 1 Valeria Tomaselli 2 Viviana d'Alto 2 Giulio Urlini 2 Carla Maria Modena 1 Stefano Messelodi 1 Sebastiano Mauro Strano 2 Günter Alce 3 Klas Hermodsson 3 Mathieu Razafimahazo 4 Thibaud Michel 4 Maria Farinella Giovanni 5
1 FBK - Fondazione Bruno Kessler [Trento, Italy]
2 STMicroelectronics
3 Sony Corporation
4 TYREX - Types and Reasoning for the Web
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
5 Università degli studi di Catania [Catania]
Abstract : In this paper, a personal assistant and navigator system for visually impaired people will be described. The showcase presented in-tends to demonstrate how partially sighted people could be aided by the technology in performing an ordinary activity, like going to a mall and moving inside it to find a specific product. We propose an Android ap-plication that integrates Pedestrian Dead Reckoning and Computer Vi-sion algorithms, using an off-the-shelf Smartphone connected to a Smart-watch. The detection, recognition and pose estimation of specific objects or features in the scene derive an estimate of user location with sub-meter accuracy when combined with a hardware-sensor pedometer. The pro-posed prototype interfaces with a user by means of Augmented Reality, exploring a variety of sensorial modalities other than just visual overlay, namely audio and haptic modalities, to create a seamless immersive user experience. The interface and interaction of the preliminary platform have been studied through specific evaluation methods. The feedback gathered will be taken into consideration to further improve the pro-posed system.
Keywords : Wearable Cameras Quality of Ex-perience Mobile Devices Assistive Technology Visually Impaired Augmented Reality Indoor Navigation
Document type :
Conference papers
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download
https://hal.inria.fr/hal-01102707
Contributor : Tyrex Equipe <>
Submitted on : Tuesday, January 13, 2015 - 1:21:29 PM
Last modification on : Thursday, October 11, 2018 - 8:48:04 AM
Long-term archiving on : Friday, September 11, 2015 - 6:38:58 AM

File

PChippendale_PersonalShoppingA...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01102707, version 1

Collections

INRIA | LIG | PERSYVAL-LAB | UGA | LIG_SRCPR

Citation

Paul Chippendale, Valeria Tomaselli, Viviana d'Alto, Giulio Urlini, Carla Maria Modena, et al.. Personal Shopping Assistance and Navigator System for Visually Impaired People. ACVR2014: Second Workshop on Assistive Computer Vision and Robotics, Sep 2014, Zurich, Switzerland. ⟨hal-01102707⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

819

Files downloads

1287

Contact


archive-ouverte@inria.fr