Skip to Main content Skip to Navigation
Conference papers

Designer Led Computational Approach to Generate Mappings for Devices with Low Gestural Resolution

Abstract : We present an approach for the semi-automatic generation of gesture mappings for devices with low gestural resolution such as the Myo Armband, an off-the-shelf EMG capture device. As an exemplar interactive task, we use text-entry: a pervasive and highly complex interaction. We quantify data related to interaction combining systematic studies (i.e., error, speed, accuracy) and semi-structured workshops with experts (e.g., cognitive load, heuristics). We then formalize these factors in a mathematical model and use optimization algorithms (i.e. simulated annealing) to find an optimum gesture mapping. We demonstrated our method in a text-entry application (i.e., complex interactive dialogue) comparing our approach with other computationally determined mappings using naive cost functions. Our results showed that the designers mapping (with all factors weighted by designers) presented a good balance on performance in all factors involved (speed, accuracy, comfort, memorability, etc.), consistently performing better than purely computational mappings. The results indicate that our hybrid approach can yield better results than either pure user-driven methodologies or pure data-driven approaches, for our application context featuring a large solution space and complex high-level factors.
Document type :
Conference papers
Complete list of metadata

Cited literature [36 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Thursday, April 16, 2020 - 2:27:48 PM
Last modification on : Thursday, April 16, 2020 - 3:23:42 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Roberto Montano-Murillo, Teng Han, Pourang Irani, Diego Martinez-Plasencia, Sriram Subramanian. Designer Led Computational Approach to Generate Mappings for Devices with Low Gestural Resolution. 17th IFIP Conference on Human-Computer Interaction (INTERACT), Sep 2019, Paphos, Cyprus. pp.623-643, ⟨10.1007/978-3-030-29381-9_38⟩. ⟨hal-02544535⟩



Record views


Files downloads