The Mind-Mirror: See Your Brain in Action in Your Head Using EEG and Augmented Reality

Jonathan Mercier-Ganady 1 Fabien Lotte 2, 3 Emilie Loup-Escande 1 Maud Marchal 1 Anatole Lécuyer 1
1 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
2 Potioc - Popular interaction with 3d content
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
Abstract : Imagine you are facing a mirror, seeing at the same time both your real body and a virtual display of your brain in activity and perfectly superimposed to your real image "inside your real skull". In this paper, we introduce a novel augmented reality paradigm called "Mind-Mirror" which enables the experience of seeing "through your own head", visualizing your brain "in action and in situ". Our approach relies on the use of a semi-transparent mirror positioned in front of a computer screen. A virtual brain is displayed on screen and automatically follows the head movements using an optical face-tracking system. The brain activity is extracted and processed in real-time with the help of an electroencephalography cap (EEG) worn by the user. A rear view is also proposed thanks to an additional webcam recording the rear of the user's head. The use of EEG classification techniques enables to test a Neurofeed- back scenario in which the user can train and progressively learn how to control different mental states, such as "concentrated" versus "relaxed". The results of a user study comparing a standard visualization used in Neurofeedback to our approach showed that the Mind-Mirror could be successfully used and that the participants have particularly appreciated its innovation and originality. We believe that, in addition to applications in Neurofeedback and Brain-Computer Interfaces, the Mind-Mirror could also be used as a novel visualization tool for education, training or entertainment applications.
Type de document :
Communication dans un congrès
IEEE Virtual Reality (VR), Mar 2014, Minneapolis, United States. IEEE, 2014
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01052681
Contributeur : Fabien Lotte <>
Soumis le : lundi 28 juillet 2014 - 14:25:40
Dernière modification le : mardi 23 janvier 2018 - 01:19:47
Document(s) archivé(s) le : mardi 25 novembre 2014 - 19:22:33

Fichier

mindmirror.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01052681, version 1

Citation

Jonathan Mercier-Ganady, Fabien Lotte, Emilie Loup-Escande, Maud Marchal, Anatole Lécuyer. The Mind-Mirror: See Your Brain in Action in Your Head Using EEG and Augmented Reality. IEEE Virtual Reality (VR), Mar 2014, Minneapolis, United States. IEEE, 2014. 〈hal-01052681〉

Partager

Métriques

Consultations de la notice

1002

Téléchargements de fichiers

1372