The Costs and Benefits of Combining Gaze and Hand Gestures for Remote Interaction

Abstract : Gaze has been proposed as an ideal modality for supporting remote target selection. We explored the potential of integrating gaze with hand gestures for remote interaction on a large display in terms of user experience and preference. We conducted a lab study to compare interaction in a photo-sorting task using gesture only, or the combination of gaze plus gesture. Results from the study show that a combination of gaze and gesture input can lead to significantly faster selection, reduced hand fatigue and increased ease of use compared to using only hand input. People largely preferred the combination of gaze for target selection and hand gestures for manipulation. However, gaze can cause particular kinds of errors and can induce a cost due to switching modalities.
Document type :
Conference papers
Complete list of metadatas

Cited literature [10 references]  Display  Hide  Download

https://hal.inria.fr/hal-01609399
Contributor : Hal Ifip <>
Submitted on : Tuesday, October 3, 2017 - 3:52:17 PM
Last modification on : Tuesday, October 3, 2017 - 3:56:58 PM

File

346946_1_En_39_Chapter.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Yanxia Zhang, Sophie Stellmach, Abigail Sellen, Andrew Blake. The Costs and Benefits of Combining Gaze and Hand Gestures for Remote Interaction. 15th Human-Computer Interaction (INTERACT), Sep 2015, Bamberg, Germany. pp.570-577, ⟨10.1007/978-3-319-22698-9_39⟩. ⟨hal-01609399⟩

Share

Metrics

Record views

83

Files downloads

112