Skip to Main content Skip to Navigation
New interface
Conference papers

Error Reducing Sampling in Reinforcement Learning

Bruno Scherrer 1 Shie Mannor 2 
1 MAIA - Autonomous intelligent machine
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : In reinforcement learning, an agent collects information interacting with an environment and uses it to derive a behavior. This paper focuses on efficient sampling; that is, the problem of choosing the interaction samples so that the corresponding behavior tends quickly to the optimal behavior. Our main result is a sensitivity analysis relating the choice of sampling any state-action pair to the decrease of an error bound on the optimal solution. We derive two new model-based algorithms. Simulations demonstrate a quicker convergence (in the sense of the number of samples) of the value function to the real optimal value function.
Document type :
Conference papers
Complete list of metadata

Cited literature [14 references]  Display  Hide  Download
Contributor : Bruno Scherrer Connect in order to contact the contributor
Submitted on : Friday, November 7, 2008 - 3:47:01 PM
Last modification on : Saturday, June 25, 2022 - 7:45:45 PM
Long-term archiving on: : Monday, June 7, 2010 - 10:49:09 PM


Files produced by the author(s)


  • HAL Id : inria-00337659, version 1



Bruno Scherrer, Shie Mannor. Error Reducing Sampling in Reinforcement Learning. NIPS-08 Workshop on Model Uncertainty and Risk in Reinforcement Learning, Dec 2008, Whistler, Canada. ⟨inria-00337659⟩



Record views


Files downloads