Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience

Fabien Benureau 1 Pierre-Yves Oudeyer 1
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : The production of behavioral diversity – producing a diversity of effects – is an essential strategy for robots exploring the world when facing situations where interaction possibilities are unknown or non-obvious. It allows to discover new aspects of the environment that cannot be inferred or deduced from available knowledge. However, creating behavioral diversity in situations where it is most crucial – new and unknown ones – is far from trivial. In particular in large and redundant sensorimotor spaces, only small areas are interesting to explore for any practical purpose. When the environment does not provide clues or gradient toward those areas, trying to discover those areas relies on chance. To address this problem, we introduce a method to create behavioral diversity in a new sensorimotor task by re-enacting actions that allowed to produce behavioral diversity in a previous task, along with a measure that quantifies this diversity. We show that our method can learn how to interact with an object by reusing experience from another, that it adapts to instances of morphological changes and of dissimilarity between tasks, and how scaffolding behaviors can emerge by simply switching the attention of the robot to different parts of the environment. Finally, we show that the method can robustly use simulated experiences and crude cognitive models to generate behavioral diversity in real robots.
Liste complète des métadonnées

https://hal.inria.fr/hal-01404329
Contributeur : Pierre-Yves Oudeyer <>
Soumis le : lundi 28 novembre 2016 - 15:49:08
Dernière modification le : mardi 17 avril 2018 - 23:01:33
Document(s) archivé(s) le : lundi 20 mars 2017 - 17:00:25

Fichier

frontiersBenureauOudeyer16.pdf
Publication financée par une institution

Licence


Distributed under a Creative Commons Paternité 4.0 International License

Identifiants

Collections

Citation

Fabien Benureau, Pierre-Yves Oudeyer. Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience. Frontiers in Robotics and AI, Frontiers Media S.A., 2016, 3 (8), 〈http://journal.frontiersin.org/article/10.3389/frobt.2016.00008/full〉. 〈10.3389/frobt.2016.00008〉. 〈hal-01404329〉

Partager

Métriques

Consultations de la notice

232

Téléchargements de fichiers

71