The Mind-Mirror: See Your Brain in Action in Your Head Using EEG and Augmented Reality

Jonathan Mercier-Ganady 1 Fabien Lotte 2, 3 Emilie Loup-Escande 1 Maud Marchal 1 Anatole Lécuyer 1
1 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
2 Potioc - Popular interaction with 3d content
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
Abstract : Imagine you are facing a mirror, seeing at the same time both your real body and a virtual display of your brain in activity and perfectly superimposed to your real image "inside your real skull". In this paper, we introduce a novel augmented reality paradigm called "Mind-Mirror" which enables the experience of seeing "through your own head", visualizing your brain "in action and in situ". Our approach relies on the use of a semi-transparent mirror positioned in front of a computer screen. A virtual brain is displayed on screen and automatically follows the head movements using an optical face-tracking system. The brain activity is extracted and processed in real-time with the help of an electroencephalography cap (EEG) worn by the user. A rear view is also proposed thanks to an additional webcam recording the rear of the user's head. The use of EEG classification techniques enables to test a Neurofeed- back scenario in which the user can train and progressively learn how to control different mental states, such as "concentrated" versus "relaxed". The results of a user study comparing a standard visualization used in Neurofeedback to our approach showed that the Mind-Mirror could be successfully used and that the participants have particularly appreciated its innovation and originality. We believe that, in addition to applications in Neurofeedback and Brain-Computer Interfaces, the Mind-Mirror could also be used as a novel visualization tool for education, training or entertainment applications.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.inria.fr/hal-01052681
Contributor : Fabien Lotte <>
Submitted on : Monday, July 28, 2014 - 2:25:40 PM
Last modification on : Thursday, May 9, 2019 - 4:16:23 PM
Long-term archiving on : Tuesday, November 25, 2014 - 7:22:33 PM

File

mindmirror.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01052681, version 1

Citation

Jonathan Mercier-Ganady, Fabien Lotte, Emilie Loup-Escande, Maud Marchal, Anatole Lécuyer. The Mind-Mirror: See Your Brain in Action in Your Head Using EEG and Augmented Reality. IEEE Virtual Reality (VR), Mar 2014, Minneapolis, United States. ⟨hal-01052681⟩

Share

Metrics

Record views

1989

Files downloads

2023