Thumbs Up: 3D Gesture Input on Mobile Phones Using the Front Facing Camera

Abstract : We use the front facing camera in a smart phone to capture gesture input. Thumb gestures performed above the camera are recognized and used to invoke commands. In contrast to other input modalities the camera requires no device movements and no valuable screen space is used. To be viable, this type of interaction requires gestures which are comfortable and memorable for the user and real-time accurate recognition of those gestures. Given the performance constraints of phones and their cameras we needed to determine whether accurate and reliable recognition is possible and identify types of gestures that are recognizable and user appropriate. As a proof of concept, we conducted a user study testing three gestures for performance and user satisfaction. The results demonstrate that the 3D gestural input is successful and we provide detailed insights into successful recognition strategies for this novel interaction modality.
Document type :
Conference papers
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download

https://hal.inria.fr/hal-01501752
Contributor : Hal Ifip <>
Submitted on : Tuesday, April 4, 2017 - 3:40:33 PM
Last modification on : Wednesday, October 17, 2018 - 4:50:09 PM
Long-term archiving on : Wednesday, July 5, 2017 - 6:05:06 PM

File

978-3-642-40480-1_20_Chapter.p...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Paul Schmieder, John Hosking, Andrew Luxton-Reilly, Beryl Plimmer. Thumbs Up: 3D Gesture Input on Mobile Phones Using the Front Facing Camera. 14th International Conference on Human-Computer Interaction (INTERACT), Sep 2013, Cape Town, South Africa. pp.318-336, ⟨10.1007/978-3-642-40480-1_20⟩. ⟨hal-01501752⟩

Share

Metrics

Record views

445

Files downloads

191