Skip to Main content Skip to Navigation
Conference papers

The Costs and Benefits of Combining Gaze and Hand Gestures for Remote Interaction

Abstract : Gaze has been proposed as an ideal modality for supporting remote target selection. We explored the potential of integrating gaze with hand gestures for remote interaction on a large display in terms of user experience and preference. We conducted a lab study to compare interaction in a photo-sorting task using gesture only, or the combination of gaze plus gesture. Results from the study show that a combination of gaze and gesture input can lead to significantly faster selection, reduced hand fatigue and increased ease of use compared to using only hand input. People largely preferred the combination of gaze for target selection and hand gestures for manipulation. However, gaze can cause particular kinds of errors and can induce a cost due to switching modalities.
Document type :
Conference papers
Complete list of metadata

Cited literature [10 references]  Display  Hide  Download
Contributor : Hal Ifip <>
Submitted on : Tuesday, October 3, 2017 - 3:52:17 PM
Last modification on : Tuesday, May 25, 2021 - 12:36:02 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Yanxia Zhang, Sophie Stellmach, Abigail Sellen, Andrew Blake. The Costs and Benefits of Combining Gaze and Hand Gestures for Remote Interaction. 15th Human-Computer Interaction (INTERACT), Sep 2015, Bamberg, Germany. pp.570-577, ⟨10.1007/978-3-319-22698-9_39⟩. ⟨hal-01609399⟩



Record views


Files downloads