Skip to Main content Skip to Navigation
Conference papers

Thumbs Up: 3D Gesture Input on Mobile Phones Using the Front Facing Camera

Abstract : We use the front facing camera in a smart phone to capture gesture input. Thumb gestures performed above the camera are recognized and used to invoke commands. In contrast to other input modalities the camera requires no device movements and no valuable screen space is used. To be viable, this type of interaction requires gestures which are comfortable and memorable for the user and real-time accurate recognition of those gestures. Given the performance constraints of phones and their cameras we needed to determine whether accurate and reliable recognition is possible and identify types of gestures that are recognizable and user appropriate. As a proof of concept, we conducted a user study testing three gestures for performance and user satisfaction. The results demonstrate that the 3D gestural input is successful and we provide detailed insights into successful recognition strategies for this novel interaction modality.
Document type :
Conference papers
Complete list of metadata

Cited literature [23 references]  Display  Hide  Download

https://hal.inria.fr/hal-01501752
Contributor : Hal Ifip <>
Submitted on : Tuesday, April 4, 2017 - 3:40:33 PM
Last modification on : Wednesday, September 23, 2020 - 9:04:07 AM
Long-term archiving on: : Wednesday, July 5, 2017 - 6:05:06 PM

File

978-3-642-40480-1_20_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Paul Schmieder, John Hosking, Andrew Luxton-Reilly, Beryl Plimmer. Thumbs Up: 3D Gesture Input on Mobile Phones Using the Front Facing Camera. 14th International Conference on Human-Computer Interaction (INTERACT), Sep 2013, Cape Town, South Africa. pp.318-336, ⟨10.1007/978-3-642-40480-1_20⟩. ⟨hal-01501752⟩

Share

Metrics

Record views

649

Files downloads

453