Multi-sensory integration by constrained self-organization

Mathieu Lefort 1 Yann Boniface 1 Bernard Girau 1
1 CORTEX - Neuromimetic intelligence
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : We develop on a model for multi-sensory integration to perform sensorimotor tasks. The aim of the model is to provide missing modality recall and generalization using cortico-inspired mechanisms. The architecture consists in several multilevel cortical maps with a generic structure. Each map has to self organize with a continuous, decentralized and unsupervised learning which provides robustness and adaptability. These self-organizations are constrained by the multi modal context to obtain multi-sensory generalization. More precisely, each modality is represented by a perceptive map and each perception by an activity bump, that emerges thanks to a competition mechanism, in the corresponding map. All perceptive maps are reciprocally and laterally connected to an unique associative map. A competition takes place in the associative map to generate an activity bump which represents the multi-sensory perception. Multi modal constraints are relaxed, thanks to the lateral connections, to converge towards coherent perceptions within a multi modal context. We will present a model of perceptive map using a modulated BCM (Bienenstock Cooper Munro) learning rule to create a self-organization at the map level, which can be influenced by the multimodal context. An unlearning mechanism adds robustness and plasticity to the architecture and makes the self-organization smoother.
Type de document :
Poster
Third EUCogII Members Conference - Multisensory integration, Oct 2010, Palma, Spain
Liste complète des métadonnées

https://hal.inria.fr/inria-00536933
Contributeur : Mathieu Lefort <>
Soumis le : mercredi 17 novembre 2010 - 11:54:15
Dernière modification le : jeudi 11 janvier 2018 - 06:19:48
Document(s) archivé(s) le : vendredi 18 février 2011 - 02:51:15

Fichier

poster.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00536933, version 1

Collections

Citation

Mathieu Lefort, Yann Boniface, Bernard Girau. Multi-sensory integration by constrained self-organization. Third EUCogII Members Conference - Multisensory integration, Oct 2010, Palma, Spain. 〈inria-00536933〉

Partager

Métriques

Consultations de la notice

207

Téléchargements de fichiers

73