Inverse Kinematics On-line Learning: a Kernel-Based Policy-Gradient approach

Emmanuel Daucé 1 Alain Dutech 2
2 MAIA - Autonomous intelligent machine
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In machine learning, ``kernel methods'' give a consistent framework for applying the perceptron algorithm to non-linear problems. In reinforcement learning, an analog of the perceptron delta-rule can be derived from the "policy-gradient" approach proposed by Williams in 1992 in the framework of stochastic neural networks. Despite its generality and straighforward applicability to continuous command problems, quite few developments of the method had been proposed since. Here we present an account of the use of a kernel transformation of the perception space for the \emph{on-line} learning of a motor command, in the case of eye orientation and multi-joint arm control. We show first that such a setting allows the system to solve non-linear problems, like the log-like resolution of a foveated retina, or the transformation from a cartesian perception space to the ``angular'' command of the multi-joint arm. More interestingly, the on-line recurrent learning we propose is simple and fully operant in changing environments, and allows for constant improvements of the politics, on the basis of simple and measurables error terms.
Type de document :
Pré-publication, Document de travail
2010
Liste complète des métadonnées

Littérature citée [14 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00520960
Contributeur : Alain Dutech <>
Soumis le : vendredi 24 septembre 2010 - 15:49:55
Dernière modification le : jeudi 18 janvier 2018 - 01:52:26
Document(s) archivé(s) le : jeudi 25 octobre 2012 - 11:30:57

Fichier

draft_nips10.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00520960, version 1

Collections

Citation

Emmanuel Daucé, Alain Dutech. Inverse Kinematics On-line Learning: a Kernel-Based Policy-Gradient approach. 2010. 〈inria-00520960〉

Partager

Métriques

Consultations de la notice

263

Téléchargements de fichiers

251