R-IAC: Robust intrinsically motivated exploration and active learning

Abstract : IAC was initially introduced as a developmental mechanism allowing a robot to self-organize developmental trajectories of increasing complexity without pre-programming the particular developmental stages. In this paper, we argue that IAC and other intrinsically motivated learning heuristics could be viewed as active learning algorithms that are particularly suited for learning forward models in unprepared sensorimotor spaces with large unlearnable subspaces. Then, we introduce a novel formulation of IAC, called R-IAC (Robust Intelligent Adaptive Curiosity), and show that its performances as an intrinsically motivated active learning algorithm are far superior to IAC in a complex sensorimotor space where only a small subspace is neither unlearnable nor trivial. We also show results in which the learnt forward model is reused in a control scheme. Finally, an open-source accompanying software containing these algorithms as well as tools to reproduce all the experiments presented in this paper is made publicly available. Index Terms-- active learning, intrinsic motivation, exploration, developmental robotics, artificial curiosity, sensorimotor learning.
Liste complète des métadonnées

Cited literature [55 references]  Display  Hide  Download

https://hal.inria.fr/hal-00818174
Contributor : Pierre-Yves Oudeyer <>
Submitted on : Friday, April 26, 2013 - 11:09:45 AM
Last modification on : Wednesday, November 29, 2017 - 3:50:05 PM
Document(s) archivé(s) le : Saturday, July 27, 2013 - 4:04:44 AM

File

TAMDBaranesOudeyer09.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Adrien Baranes, Pierre-Yves Oudeyer. R-IAC: Robust intrinsically motivated exploration and active learning. IEEE Transactions on Autonomous Mental Development, IEEE, 2009, 1 (3), pp.155-169. ⟨http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5342516&tag=1⟩. ⟨10.1109/TAMD.2009.2037513⟩. ⟨hal-00818174⟩

Share

Metrics

Record views

360

Files downloads

424