Variance Reduction in Population-Based Optimization: Application to Unit Commitment

Jean-Joseph Christophe 1, 2 Jérémie Decock 1, 2 Jialin Liu 2, 1 Olivier Teytaud 1, 2
2 TAO - Machine Learning and Optimisation
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : We consider noisy optimization and some traditional variance reduction techniques aimed at improving the convergence rate, namely (i) common random numbers (CRN), which is relevant for population-based noisy optimization and (ii) stratified sampling, which is relevant for most noisy optimization problems. We present artificial models of noise for which common random numbers are very efficient, and artificial models of noise for which common random numbers are detrimental. We then experiment on a desperately expensive unit commitment problem. As expected, stratified sampling is never detrimental. Nonetheless, in practice, common random numbers provided, by far, most of the improvement .
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [25 references]  Display  Hide  Download

https://hal.inria.fr/hal-01194510
Contributor : Olivier Teytaud <>
Submitted on : Monday, September 7, 2015 - 10:35:10 AM
Last modification on : Thursday, April 5, 2018 - 12:30:12 PM
Document(s) archivé(s) le : Tuesday, December 8, 2015 - 10:48:27 AM

File

EAsource.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01194510, version 1

Citation

Jean-Joseph Christophe, Jérémie Decock, Jialin Liu, Olivier Teytaud. Variance Reduction in Population-Based Optimization: Application to Unit Commitment. Artificial Evolution (EA2015), 2015, Lyon, France. ⟨hal-01194510⟩

Share

Metrics

Record views

490

Files downloads

267