inria-00116344, version 1
Genetic Programming for Kernel-based Learning with Co-evolving Subsets Selection
Christian Gagné a, 1, 2Marc Schoenauer
b, 1, 3Michèle Sebag
c, 3Marco Tomassini a, 2
PPSN'06 4193 (2006) 1008-1017
Résumé : Support Vector Machines (SVMs) are well-established Machine Learning (ML) algorithms. They rely on the fact that i) linear learning can be formalized as a well-posed optimization problem; ii) non-linear learning can be brought into linear learning thanks to the kernel trick and the mapping of the initial search space onto a high dimensional feature space. The kernel is designed by the ML expert and it governs the efficiency of the SVM approach. In this paper, a new approach for the automatic design of kernels by Genetic Programming, called the Evolutionary Kernel Machine (EKM), is presented. EKM combines a well-founded fitness function inspired from the margin criterion, and a co-evolution framework ensuring the computational scalability of the approach. Empirical validation on standard ML benchmark demonstrates that EKM is competitive using state-of-the-art SVMs with tuned hyper-parameters.
- a – Université de Lausanne
- b – INRIA
- c – CNRS
- 1 : TAO (INRIA Futurs)
- INRIA – CNRS : UMR8623 – Université Paris XI - Paris Sud
- 2 : Information Systems Institute (ISI)
- Université de Lausanne
- 3 : Laboratoire de Recherche en Informatique (LRI)
- CNRS : UMR8623 – Université Paris XI - Paris Sud
- Domaine : Informatique/Intelligence artificielle
- inria-00116344, version 1
- http://hal.inria.fr/inria-00116344
- oai:hal.inria.fr:inria-00116344
- Contributeur : Marc Schoenauer
- Soumis le : Dimanche 26 Novembre 2006, 11:45:19
- Dernière modification le : Lundi 27 Novembre 2006, 15:38:55






Documents associés

Exporter