Representational Content of Oscillatory Brain Activity during Object Recognition: Contrasting Cortical and Deep Neural Network Hierarchies - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue eNeuro Année : 2021

Representational Content of Oscillatory Brain Activity during Object Recognition: Contrasting Cortical and Deep Neural Network Hierarchies

Résumé

Numerous theories propose a key role for brain oscillations in visual perception. Most of these theories postulate that sensory information is encoded in specific oscillatory components (e.g., power or phase) of specific frequency bands. These theories are often tested with whole-brain recording methods of low spatial resolution (EEG or MEG), or depth recordings that provide a local, incomplete view of the brain. Opportunities to bridge the gap between local neural populations and whole-brain signals are rare. Here, using representational similarity analysis (RSA) in human participants we explore which MEG oscillatory components (power and phase, across various frequency bands) correspond to low or high-level visual object representations, using brain representations from fMRI, or layer-wise representations in seven recent deep neural networks (DNNs), as a template for low/high-level object representations. The results showed that around stimulus onset and offset, most transient oscillatory signals correlated with low-level brain patterns (V1). During stimulus presentation, sustained b (;20 Hz) and g (.60 Hz) power best correlated with V1, while oscillatory phase components correlated with IT representations. Surprisingly, this pattern of results did not always correspond to low-level or high-level DNN layer activity. In particular, sustained b band oscillatory power reflected high-level DNN layers, suggestive of a feedback component. These results begin to bridge the gap between whole-brain oscillatory signals and object representations supported by local neuronal activations.
Fichier principal
Vignette du fichier
Reddy_Cichy_VanRullen_2021.pdf (3.15 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03264349 , version 1 (18-06-2021)

Identifiants

Citer

Leila Reddy, Radoslaw Martin Cichy, Rufin Vanrullen. Representational Content of Oscillatory Brain Activity during Object Recognition: Contrasting Cortical and Deep Neural Network Hierarchies. eNeuro, 2021, 8 (3), pp.ENEURO.0362 - 20.2021. ⟨10.1523/eneuro.0362-20.2021⟩. ⟨hal-03264349⟩
42 Consultations
26 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More