Optimal Brain Surgeon Variants for Optimization

Mohammed Attik 1 Laurent Bougrain 1 Frédéric Alexandre 1
1 CORTEX - Neuromimetic intelligence
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : The determination of the optimal architecture of a multilayer perceptron (MLP) to solve a specific problem is an important and a difficult task. Several approaches based on saliency analysis, such as the Optimal Brain Surgeon method (OBS), have been developed in this field. Nevertheless, we show in this paper that OBS does not gives an optimal architecture. We also present the advantages of applying OBS on the architecture obtained by a variable selection method. New hybrid methods are proposed. A comparison of our approaches to standard techniques for architecture optimization is presented Simulation results obtained on the Monk's problem illustrate the specificities of each method described in this paper.
Type de document :
Communication dans un congrès
16h European Conference on Artificial Intelligence - ECAI'04, 2004, Valencia, Spain, 2 p, 2004
Liste complète des métadonnées

https://hal.inria.fr/inria-00099924
Contributeur : Publications Loria <>
Soumis le : mardi 26 septembre 2006 - 10:09:50
Dernière modification le : jeudi 11 janvier 2018 - 06:19:48
Document(s) archivé(s) le : mercredi 29 mars 2017 - 12:52:11

Fichiers

Identifiants

  • HAL Id : inria-00099924, version 1

Collections

Citation

Mohammed Attik, Laurent Bougrain, Frédéric Alexandre. Optimal Brain Surgeon Variants for Optimization. 16h European Conference on Artificial Intelligence - ECAI'04, 2004, Valencia, Spain, 2 p, 2004. 〈inria-00099924〉

Partager

Métriques

Consultations de la notice

261

Téléchargements de fichiers

26