Active Learning for Teaching a Robot Grounded Relational Symbols

Johannes Kulick 1 Tobias Lang 1 Marc Toussaint 1 Manuel Lopes 2
2 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : We investigate an interactive teaching scenario, where a human teaches a robot symbols which abstract the geometric properties of objects. There are multiple motivations for this scenario: First, state-of-the-art methods for relational reinforcement learning demonstrate that we can learn and employ strongly generalizing abstract models with great success for goal-directed object manipulation. However, these methods rely on given grounded action and state symbols and raise the classical question: Where do the symbols come from? Second, existing research on learning from human-robot interaction has focused mostly on the motion level (e.g., imitation learning). However, if the goal of teaching is to enable the robot to autonomously solve sequential manipulation tasks in a goal-directed manner, the human should have the possibility to teach the relevant abstractions to describe the task and let the robot eventually leverage powerful relational RL methods. In this paper we formalize human-robot teaching of grounded symbols as an active learning problem, where the robot actively generates pick-and-place geometric situations that maximize its information gain about the symbol to be learned. We demonstrate that the learned symbols can be used by a robot in a relational RL framework to learn probabilistic relational rules and use them to solve object manipulation tasks in a goal-directed manner.
Type de document :
Communication dans un congrès
International Joint Conference on Artificial Intelligence, 2013, Beijing, China. 2013, 〈http://ijcai.org/papers13/Papers/IJCAI13-217.pdf〉
Liste complète des métadonnées

https://hal.inria.fr/hal-00871858
Contributeur : Manuel Lopes <>
Soumis le : jeudi 10 octobre 2013 - 17:30:05
Dernière modification le : jeudi 16 novembre 2017 - 17:12:03

Identifiants

  • HAL Id : hal-00871858, version 1

Collections

Citation

Johannes Kulick, Tobias Lang, Marc Toussaint, Manuel Lopes. Active Learning for Teaching a Robot Grounded Relational Symbols. International Joint Conference on Artificial Intelligence, 2013, Beijing, China. 2013, 〈http://ijcai.org/papers13/Papers/IJCAI13-217.pdf〉. 〈hal-00871858〉

Partager

Métriques

Consultations de la notice

116