Skip to Main content Skip to Navigation
Conference papers

Active Learning for Teaching a Robot Grounded Relational Symbols

Johannes Kulick 1 Tobias Lang 1 Marc Toussaint 1 Manuel Lopes 2
2 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
Abstract : We investigate an interactive teaching scenario, where a human teaches a robot symbols which abstract the geometric properties of objects. There are multiple motivations for this scenario: First, state-of-the-art methods for relational reinforcement learning demonstrate that we can learn and employ strongly generalizing abstract models with great success for goal-directed object manipulation. However, these methods rely on given grounded action and state symbols and raise the classical question: Where do the symbols come from? Second, existing research on learning from human-robot interaction has focused mostly on the motion level (e.g., imitation learning). However, if the goal of teaching is to enable the robot to autonomously solve sequential manipulation tasks in a goal-directed manner, the human should have the possibility to teach the relevant abstractions to describe the task and let the robot eventually leverage powerful relational RL methods. In this paper we formalize human-robot teaching of grounded symbols as an active learning problem, where the robot actively generates pick-and-place geometric situations that maximize its information gain about the symbol to be learned. We demonstrate that the learned symbols can be used by a robot in a relational RL framework to learn probabilistic relational rules and use them to solve object manipulation tasks in a goal-directed manner.
Document type :
Conference papers
Complete list of metadatas

https://hal.inria.fr/hal-00871858
Contributor : Manuel Lopes <>
Submitted on : Thursday, October 10, 2013 - 5:30:05 PM
Last modification on : Wednesday, July 3, 2019 - 10:48:04 AM

Identifiers

  • HAL Id : hal-00871858, version 1

Collections

Citation

Johannes Kulick, Tobias Lang, Marc Toussaint, Manuel Lopes. Active Learning for Teaching a Robot Grounded Relational Symbols. International Joint Conference on Artificial Intelligence, 2013, Beijing, China. ⟨hal-00871858⟩

Share

Metrics

Record views

214