inria-00536933, version 1

Multi-sensory integration by constrained self-organization

Mathieu Lefort () ¹, Yann Boniface () ^a, 1, Bernard Girau () ¹

Third EUCogII Members Conference - Multisensory integration (2010)

• a –  INRIA
• 1 :  CORTEX (INRIA Lorraine - LORIA)
• 
  INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL) France

Références bibliographiques

• Type de publication : Documents associés à des manifestations scientifiques (Tutoriel, poster/prés./préface, papier court, digest de conférence, …)
• Domaine : Informatique/Réseau de neurones
• Titre : Multi-sensory integration by constrained self-organization
• Résumé : We develop on a model for multi-sensory integration to perform sensorimotor tasks. The aim of the model is to provide missing modality recall and generalization using cortico-inspired mechanisms. The architecture consists in several multilevel cortical maps with a generic structure. Each map has to self organize with a continuous, decentralized and unsupervised learning which provides robustness and adaptability. These self-organizations are constrained by the multi modal context to obtain multi-sensory generalization. More precisely, each modality is represented by a perceptive map and each perception by an activity bump, that emerges thanks to a competition mechanism, in the corresponding map. All perceptive maps are reciprocally and laterally connected to an unique associative map. A competition takes place in the associative map to generate an activity bump which represents the multi-sensory perception. Multi modal constraints are relaxed, thanks to the lateral connections, to converge towards coherent perceptions within a multi modal context. We will present a model of perceptive map using a modulated BCM (Bienenstock Cooper Munro) learning rule to create a self-organization at the map level, which can be influenced by the multimodal context. An unlearning mechanism adds robustness and plasticity to the architecture and makes the self-organization smoother.
• Langue du document : Anglais
• Audience : internationale
• Document de vulgarisation : Non
• Titre conférence : Third EUCogII Members Conference - Multisensory integration
• Ville : Palma
• Pays : Espagne
• Date conférence : 08/10/2010
• Date conférence (fin) : 09/10/2010
• Type de document : Poster

Liste des fichiers attachés à ce document :

• inria-00536933, version 1
• http://hal.inria.fr/inria-00536933
• oai:hal.inria.fr:inria-00536933
• Contributeur : Mathieu Lefort <>
• Soumis le : Mercredi 17 Novembre 2010, 11:54:15
• Dernière modification le : Mercredi 17 Novembre 2010, 20:03:51