inria-00173204, version 1
Active learning in regression, with an application to stochastic dynamic programming
Olivier Teytaud
1Sylvain Gelly 1Jérémie Mary 1
ICINCO 2007 (2007)
Abstract: We study active learning as a derandomized form of sampling. We show that full derandomization is not suitable in a robust framework, propose partially derandomized samplings, and develop new active learning methods (i) in which expert knowledge is easy to integrate (ii) with a parameter for the exploration/exploitation dilemma (iii) less randomized than the full-random sampling (yet also not deterministic). Experiments are performed in the case of regression for value-function learning on a continuous domain. Our main results are (i) efficient partially derandomized point sets (ii) moderate-derandomization theorems (iii) experimental evidence of the importance of the frontier (iv) a new regression-specific user-friendly sampling tool lessrobust than blind samplers but that sometimes works very efficiently in large dimensions. All experiments can be reproduced by downloading the source code and running the provided command line.
- 1: TAO (INRIA Futurs)
- INRIA – CNRS : UMR8623 – Université Paris XI - Paris Sud
- Domain : Mathematics/Optimization and Control
- Keywords : Active Learning – Stochastic Dynamic Programming – Sampling
- inria-00173204, version 1
- http://hal.inria.fr/inria-00173204
- oai:hal.inria.fr:inria-00173204
- From: Olivier Teytaud
- Submitted on: Wednesday, 19 September 2007 14:15:17
- Updated on: Wednesday, 19 September 2007 14:20:32






Associated documents
Export