Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, Epiciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

Efficient online bootstrapping of sensory representations

Alexander Gepperth 1, * 
* Corresponding author
Abstract : This is a simulation-based contribution exploring a novel approach to the open-ended formation of multimodal representations in autonomous agents. In particular, we address the issue of transferring ("bootstrapping") feature selectivities between two modalities, from a previously learned or innate reference representation to a new induced representation. We demonstrate the potential of this algorithm by several experiments with synthetic inputs modeled after a robotics scenario where multimodal object representations are "bootstrapped" from a (reference) representation of object affordances. We focus on typical challenges in autonomous agents: absence of human supervision, changing environment statistics and limited computing power. We propose an autonomous and local neural learning algorithm termed PROPRE (projection-prediction) that updates induced representations based on predictability: competitive advantages are given to those feature-sensitive elements that are inferable from activities in the reference representation. PROPRE implements a bi-directional interaction of clustering ("projection") and inference ("prediction"), the key ingredient being an efficient online measure of predictability controlling learning in the projection step. We show that the proposed method is computationally efficient and stable, and that the multimodal transfer of feature selectivity is successful and robust under resource constraints. Furthermore, we successfully demonstrate robustness to noisy reference representations, non-stationary input statistics and uninformative inputs.
Document type :
Journal articles
Complete list of metadata

Cited literature [22 references]  Display  Hide  Download
Contributor : Alexander Gepperth Connect in order to contact the contributor
Submitted on : Wednesday, December 12, 2012 - 11:38:02 AM
Last modification on : Saturday, March 26, 2022 - 3:18:12 AM
Long-term archiving on: : Wednesday, March 13, 2013 - 3:51:45 AM


Files produced by the author(s)




Alexander Gepperth. Efficient online bootstrapping of sensory representations. Neural Networks, Elsevier, 2012, Special Issue on Autonomous Learning, ⟨10.1016/j.neunet.2012.11.002⟩. ⟨hal-00763660⟩



Record views


Files downloads