Skip to Main content Skip to Navigation
Conference papers

Active Learning for Accurate Estimation of Linear Models

Carlos Riquelme 1 Mohammad Ghavamzadeh 2, 3 Alessandro Lazaric 2
2 SEQUEL - Sequential Learning
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
Abstract : We explore the sequential decision-making problem where the goal is to estimate a number of linear models uniformly well, given a shared budget of random contexts independently sampled from a known distribution. For each incoming context, the decision-maker selects one of the linear models and receives an observation that is corrupted by the unknown noise level of that model. We present Trace-UCB, an adaptive allocation algorithm that learns the models' noise levels while balancing contexts accordingly across them, and prove bounds for its simple regret in both expectation and high-probability. We extend the algorithm and its bounds to the high dimensional setting , where the number of linear models times the dimension of the contexts is more than the total budget of samples. Simulations with real data suggest that Trace-UCB is remarkably robust , outperforming a number of baselines even when its assumptions are violated.
Document type :
Conference papers
Complete list of metadata

Cited literature [17 references]  Display  Hide  Download
Contributor : Alessandro Lazaric Connect in order to contact the contributor
Submitted on : Wednesday, June 14, 2017 - 10:14:58 AM
Last modification on : Friday, January 21, 2022 - 3:13:17 AM
Long-term archiving on: : Tuesday, December 12, 2017 - 1:03:34 PM


Files produced by the author(s)


  • HAL Id : hal-01538762, version 1



Carlos Riquelme, Mohammad Ghavamzadeh, Alessandro Lazaric. Active Learning for Accurate Estimation of Linear Models. ICML 2017 - 34th International Conference on Machine Learning, Aug 2017, Sydney, Australia. pp.36. ⟨hal-01538762⟩



Les métriques sont temporairement indisponibles