Coupling BCM and neural fields for the emergence of self-organization consensus

Abstract : Human beings interact with the environment through different modalities, i.e. perceptions and actions, processed in the cortex by dedicated brain areas. This areas are self-organized, so that spatially close neurons are sensitive to close stimuli, providing generalization from previously learn examples. Although perceptive flows are picked up by different spatially separated sensors, their processing are not isolated. On the contrary, they are constantly interacting, as illustrated by the McGurk effect. When the auditory stimulus /ba/ and the /ga/ lip movement are presented simultaneously, people perceive a /da/, which does not correspond to any of the stimuli. Merging several stimuli into one multimodal perception reduces ambiguities and noises and is essential to interact with the environment. This article proposes a model for modalities association, inspired by the biological properties of the cortex. The model consists on modality maps interacting through an associative map to raise a consistent multimodal perception of the environment. We propose the coupling of BCM learning rule and neural maps to obtain the decentralized and unsupervised self-organization of each modal map influenced by the multisensory context.