Efficient online bootstrapping of sensory representations

Alexander Gepperth 1, *
* Corresponding author
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : This is a simulation-based contribution exploring a novel approach to the open-ended formation of multimodal representations in autonomous agents. In particular, we address the issue of transferring ("bootstrapping") feature selectivities between two modalities, from a previously learned or innate reference representation to a new induced representation. We demonstrate the potential of this algorithm by several experiments with synthetic inputs modeled after a robotics scenario where multimodal object representations are "bootstrapped" from a (reference) representation of object affordances. We focus on typical challenges in autonomous agents: absence of human supervision, changing environment statistics and limited computing power. We propose an autonomous and local neural learning algorithm termed PROPRE (projection-prediction) that updates induced representations based on predictability: competitive advantages are given to those feature-sensitive elements that are inferable from activities in the reference representation. PROPRE implements a bi-directional interaction of clustering ("projection") and inference ("prediction"), the key ingredient being an efficient online measure of predictability controlling learning in the projection step. We show that the proposed method is computationally efficient and stable, and that the multimodal transfer of feature selectivity is successful and robust under resource constraints. Furthermore, we successfully demonstrate robustness to noisy reference representations, non-stationary input statistics and uninformative inputs.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [22 references]  Display  Hide  Download

https://hal.inria.fr/hal-00763660
Contributor : Alexander Gepperth <>
Submitted on : Wednesday, December 12, 2012 - 11:38:02 AM
Last modification on : Thursday, November 16, 2017 - 5:12:03 PM
Document(s) archivé(s) le : Wednesday, March 13, 2013 - 3:51:45 AM

File

paper.pdf
Files produced by the author(s)

Identifiers

Citation

Alexander Gepperth. Efficient online bootstrapping of sensory representations. Neural Networks, Elsevier, 2012, Special Issue on Autonomous Learning, ⟨10.1016/j.neunet.2012.11.002⟩. ⟨hal-00763660⟩

Share

Metrics

Record views

580

Files downloads

188