Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Learning 2-in-1: Towards Integrated EEG-fMRI-Neurofeedback

Lorraine Perronnet 1 Anatole Lécuyer 2 Marsel Mano 1 Mathis Fleury 1 Giulia Lioi 1 Claire Cury 1 Maureen Clerc 3, 4 Fabien Lotte 5 Christian Barillot 1
1 Empenn
INSERM - Institut National de la Santé et de la Recherche Médicale, Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
2 Hybrid - 3D interaction with virtual environments using body and mind
Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
5 Potioc - Popular interaction with 3d content
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest
Abstract : Neurofeedback (NF) allows to exert self-regulation over specific aspects of one's own brain activity by returning information extracted in real-time from brain activity measures. These measures are usually acquired from a single modality, most commonly electroencephalography (EEG) or functional magnetic resonance imaging (fMRI). EEG-fMRI-neurofeedback (EEG-fMRI-NF) is a new approach that consists in providing a NF based simultaneously on EEG and fMRI signals. By exploiting the complementarity of these two modalities, EEG-fMRI-NF opens a new spectrum of possibilities for defining bimodal NF targets that could be more robust, flexible and effective than unimodal ones. Since EEG-fMRI-NF allows for a richer amount of information to be fed back, the question arises of how to represent the EEG and fMRI features simultaneously in order to allow the subject to achieve better self-regulation. In this work, we propose to represent EEG and fMRI features in a single bimodal feedback (integrated feedback). We introduce two integrated feedback strategies for EEG-fMRI-NF and compare their early effects on a motor imagery task with a between-group design. The BiDim group (n=10) was shown a two-dimensional (2D) feedback in which each dimension depicted the information from one modality. The UniDim group (n=10) was shown a one-dimensional (1D) feedback that integrated both types of information even further by merging them into one. Online fMRI activations were significantly higher in the UniDim group than in the BiDim group, which suggests that the 1D feedback is easier to control than the 2D feedback. However subjects from the BiDim group produced more specific BOLD activations with a notably stronger activation in the right superior parietal lobe (BiDim > UniDim, p < 0.001, uncorrected). These results suggest that the 2D feedback encourages subjects to explore their strategies to recruit more specific brain patterns. To summarize, our study shows that 1D and 2D integrated feedbacks are effective but also appear to be complementary and could therefore be used in a bimodal NF training program. Altogether, our study paves the way to novel integrated feedback strategies for the development of flexible and effective bimodal NF paradigms that fully exploits bimodal information and are adapted to clinical applications.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [109 references]  Display  Hide  Download
Contributor : Claire Cury <>
Submitted on : Friday, March 27, 2020 - 6:09:54 PM
Last modification on : Wednesday, October 14, 2020 - 4:22:47 AM


Files produced by the author(s)


  • HAL Id : hal-02522245, version 1


Lorraine Perronnet, Anatole Lécuyer, Marsel Mano, Mathis Fleury, Giulia Lioi, et al.. Learning 2-in-1: Towards Integrated EEG-fMRI-Neurofeedback. 2020. ⟨hal-02522245⟩



Record views


Files downloads