Boosted and Reward-regularized Classification for Apprenticeship Learning

Abstract : This paper deals with the problem of learning from demonstrations, where an agent called the apprentice tries to learn a behavior from demonstrations of another agent called the expert. To address this problem, we place ourselves into the Markov Decision Process (MDP) framework, which is well suited for sequential decision making problems. A way to tackle this problem is to reduce it to classification but doing so we do not take into account the MDP structure. Other methods which take into account the MDP structure need to solve MDPs which is a difficult task and/or need a choice of features which is problem-dependent. The main contribution of the paper is to extend a large margin approach, which is a classification method, by adding a regularization term which takes into account the MDP structure. The derived algorithm, called Reward-regularized Classification for Apprenticeship Learning (RCAL), does not need to solve MDPs. But, the major advantage is that it can be boosted: this avoids the choice of features, which is a drawback of parametric approaches. A state of the art experiment (Highway) and generic experiments (structured Garnets) are conducted to show the performance of RCAL compared to algorithms from the literature.
Type de document :
Communication dans un congrès
AAMAS 2014 : 13th International Conference on Autonomous Agents and Multiagent Systems, May 2014, Paris, France. ACM, pp.1249-1256
Liste complète des métadonnées

https://hal.inria.fr/hal-01107837
Contributeur : Olivier Pietquin <>
Soumis le : mercredi 21 janvier 2015 - 16:15:17
Dernière modification le : mardi 24 avril 2018 - 13:52:01

Identifiants

  • HAL Id : hal-01107837, version 1

Citation

Bilal Piot, Matthieu Geist, Olivier Pietquin. Boosted and Reward-regularized Classification for Apprenticeship Learning. AAMAS 2014 : 13th International Conference on Autonomous Agents and Multiagent Systems, May 2014, Paris, France. ACM, pp.1249-1256. 〈hal-01107837〉

Partager

Métriques

Consultations de la notice

1047