Skip to Main content Skip to Navigation
Conference papers

Optimal Brain Surgeon Variants for Optimization

Mohammed Attik 1 Laurent Bougrain 1 Frédéric Alexandre 1
1 CORTEX - Neuromimetic intelligence
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : The determination of the optimal architecture of a multilayer perceptron (MLP) to solve a specific problem is an important and a difficult task. Several approaches based on saliency analysis, such as the Optimal Brain Surgeon method (OBS), have been developed in this field. Nevertheless, we show in this paper that OBS does not gives an optimal architecture. We also present the advantages of applying OBS on the architecture obtained by a variable selection method. New hybrid methods are proposed. A comparison of our approaches to standard techniques for architecture optimization is presented Simulation results obtained on the Monk's problem illustrate the specificities of each method described in this paper.
Document type :
Conference papers
Complete list of metadata

https://hal.inria.fr/inria-00099924
Contributor : Publications Loria <>
Submitted on : Tuesday, September 26, 2006 - 10:09:50 AM
Last modification on : Monday, April 19, 2021 - 5:30:05 PM
Long-term archiving on: : Wednesday, March 29, 2017 - 12:52:11 PM

Identifiers

  • HAL Id : inria-00099924, version 1

Collections

Citation

Mohammed Attik, Laurent Bougrain, Frédéric Alexandre. Optimal Brain Surgeon Variants for Optimization. 16h European Conference on Artificial Intelligence - ECAI'04, 2004, Valencia, Spain, 2 p. ⟨inria-00099924⟩

Share

Metrics

Record views

462

Files downloads

154