hal-00446520, version 2
Additive Kernels for Gaussian Process Modeling
Nicolas Durrande
1, 2David Ginsbourger
3Olivier Roustant
1, 2, 4
preprint submitted to CSDA (2010)
Abstract: Gaussian Process (GP) models are often used as mathematical approximations of computationally expensive experiments. Provided that its kernel is suitably chosen and that enough data is available to obtain a reasonable fit of the simulator, a GP model can beneficially be used for tasks such as prediction, optimization, or Monte-Carlo-based quantification of uncertainty. However, the former conditions become unrealistic when using classical GPs as the dimension of input increases. One popular alternative is then to turn to Generalized Additive Models (GAMs), relying on the assumption that the simulator's response can approximately be decomposed as a sum of univariate functions. If such an approach has been successfully applied in approximation, it is nevertheless not completely compatible with the GP framework and its versatile applications. The ambition of the present work is to give an insight into the use of GPs for additive models by integrating additivity within the kernel, and proposing a parsimonious numerical method for data-driven parameter estimation. The first part of this article deals with the kernels naturally associated to additive processes and the properties of the GP models based on such kernels. The second part is dedicated to a numerical procedure based on relaxation for additive kernel parameter estimation. Finally, the efficiency of the proposed method is illustrated and compared to other approaches on Sobol's g-function.
- 1: Equipe : Calcul de Risque, Optimisation et Calage par Utilisation de Simulateurs (CROCUS-ENSMSE)
- UR LSTI – Ecole Nationale Supérieure des Mines de Saint-Etienne
- 2: Département Décision en Entreprise : Modélisation, Optimisation (DEMO-ENSMSE)
- Institut Henri Fayol – Ecole Nationale Supérieure des Mines de Saint-Etienne
- 3: Institute of Mathematical Statistics and Actuarial Science
- University of Bern
- 4: GdR MASCOT-NUM ((Méthodes d'Analyse Stochastique des Codes et Traitements Numériques))
- CNRS : GDR3179
- Domain : Statistics/Other Statistics
Statistics/Machine Learning - Keywords : Kriging – Computer Experiment – Additive Models – GAM – Maximum Likelihood Estimation – Relaxed Optimization – Sensitivity Analysis
- Available versions : v1 (2010-01-19) v2 (2011-03-21)
- hal-00446520, version 2
- http://hal.archives-ouvertes.fr/hal-00446520
- oai:hal.archives-ouvertes.fr:hal-00446520
- From: Nicolas Durrande
- Submitted on: Monday, 21 March 2011 11:19:38
- Updated on: Monday, 21 May 2012 14:54:11






Associated documents

Export