Design and Evaluation of Fusion Approach for Combining Brain and Gaze Inputs for Target Selection

Andéol Évain 1 Ferran Argelaguet Sanz 1 Géry Casiez 2 Nicolas Roussel 2 Anatole Lécuyer 1
1 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
2 MJOLNIR - Computing tools to empower users
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : Gaze-based interfaces and Brain-Computer Interfaces (BCIs) allow for hands-free human–computer interaction. In this paper, we investigate the combination of gaze and BCIs. We propose a novel selection technique for 2D target acquisition based on input fusion. This new approach combines the probabilistic models for each input, in order to better estimate the intent of the user. We evaluated its performance against the existing gaze and brain–computer interaction techniques. Twelve participants took part in our study, in which they had to search and select 2D targets with each of the evaluated techniques. Our fusion-based hybrid interaction technique was found to be more reliable than the previous gaze and BCI hybrid interaction techniques for 10 participants over 12, while being 29% faster on average. However, similarly to what has been observed in hybrid gaze-and-speech interaction, gaze-only interaction technique still provides the best performance. Our results should encourage the use of input fusion, as opposed to sequential interaction, in order to design better hybrid interfaces.
Document type :
Journal articles
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download

https://hal.inria.fr/hal-01388528
Contributor : Ferran Argelaguet Sanz <>
Submitted on : Thursday, October 27, 2016 - 10:53:15 AM
Last modification on : Thursday, March 21, 2019 - 2:50:22 PM

File

manuscript.pdf
Files produced by the author(s)

Identifiers

Citation

Andéol Évain, Ferran Argelaguet Sanz, Géry Casiez, Nicolas Roussel, Anatole Lécuyer. Design and Evaluation of Fusion Approach for Combining Brain and Gaze Inputs for Target Selection. Frontiers in Neuroscience, Frontiers, 2016, 10 (454), pp.14. ⟨10.3389/fnins.2016.00454⟩. ⟨hal-01388528⟩

Share

Metrics

Record views

1167

Files downloads

211