HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

A survey on high-dimensional Gaussian process modeling with application to Bayesian optimization

Abstract : Bayesian Optimization, the application of Bayesian function approximation to finding optima of expensive functions, has exploded in popularity in recent years. In particular, much attention has been paid to improving its efficiency on problems with many parameters to optimize. This attention has trickled down to the workhorse of high dimensional BO, high dimensional Gaussian process regression, which is also of independent interest. The great flexibility that the Gaussian process prior implies is a boon when modeling complicated, low dimensional surfaces but simply says too little when dimension grows too large. A variety of structural model assumptions have been tested to tame high dimensions, from variable selection and additive decomposition to low dimensional embeddings and beyond. Most of these approaches in turn require modifications of the acquisition function optimization strategy as well. Here we review the defining structural model assumptions and discuss the benefits and drawbacks of these approaches in practice.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

https://hal.inria.fr/hal-03419959
Contributor : Mickaël Binois Connect in order to contact the contributor
Submitted on : Friday, May 13, 2022 - 11:03:12 AM
Last modification on : Tuesday, May 17, 2022 - 4:39:06 PM

Files

SurveyHighDimBO_hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03419959, version 2
  • ARXIV : 2111.05040

Collections

Citation

Mickael Binois, Nathan Wycoff. A survey on high-dimensional Gaussian process modeling with application to Bayesian optimization. 2022. ⟨hal-03419959v2⟩

Share

Metrics

Record views

45

Files downloads

205