Skip to Main content Skip to Navigation
Conference papers

Thumbs Up: 3D Gesture Input on Mobile Phones Using the Front Facing Camera

Abstract : We use the front facing camera in a smart phone to capture gesture input. Thumb gestures performed above the camera are recognized and used to invoke commands. In contrast to other input modalities the camera requires no device movements and no valuable screen space is used. To be viable, this type of interaction requires gestures which are comfortable and memorable for the user and real-time accurate recognition of those gestures. Given the performance constraints of phones and their cameras we needed to determine whether accurate and reliable recognition is possible and identify types of gestures that are recognizable and user appropriate. As a proof of concept, we conducted a user study testing three gestures for performance and user satisfaction. The results demonstrate that the 3D gestural input is successful and we provide detailed insights into successful recognition strategies for this novel interaction modality.
Document type :
Conference papers
Complete list of metadata

Cited literature [23 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Tuesday, April 4, 2017 - 3:40:33 PM
Last modification on : Wednesday, September 23, 2020 - 9:04:07 AM
Long-term archiving on: : Wednesday, July 5, 2017 - 6:05:06 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Paul Schmieder, John Hosking, Andrew Luxton-Reilly, Beryl Plimmer. Thumbs Up: 3D Gesture Input on Mobile Phones Using the Front Facing Camera. 14th International Conference on Human-Computer Interaction (INTERACT), Sep 2013, Cape Town, South Africa. pp.318-336, ⟨10.1007/978-3-642-40480-1_20⟩. ⟨hal-01501752⟩



Record views


Files downloads