inria-00351930, version 1
The Equi-Correlation Network: a New Kernelized-LARS with Automatic Kernel Parameters Tuning
Manuel Loth 1, 2Philippe Preux 1, 2
N° RR-6794 (2008)
Résumé : Machine learning heavily relies on the ability to learn/approximate real functions. State variables, the perceptions, internal states, etc, of an agent are often represented as real numbers; grounded on them, the agent has to predict something, or act in some way. In this view, this outcome is a nonlinear function of the inputs. It is thus a very common task to fit a nonlinear function to observations, namely solving a regression problem. Among other approaches, the LARS is very appealing, for its nice theoretical properties, and actual efficiency to compute the whole $l_1$ regularization path of a supervised learning problem, along with the sparsity. In this paper, we consider the kernelized version of the LARS. In this setting, kernel functions generally have some parameters that have to be tuned. In this paper, we propose a new algorithm, the Equi-Correlation Network (ECON), which originality is that while computing the regularization path, ECON automatically tunes kernel hyper-parameters; thus, this opens the way to working with infinitely many kernel functions, from which, the most interesting are selected. Interestingly, our algorithm is still computationaly efficient, and provide state-of-the-art results on standard benchmarks, while lessening the hand-tuning burden.
- 1 : Laboratoire d'Informatique Fondamentale de Lille (LIFL)
- CNRS : UMR8022 – INRIA – IRCICA – Université des Sciences et Technologies de Lille - Lille I
- 2 : SEQUEL (INRIA Lille - Nord Europe)
- INRIA – CNRS : UMR8022 – CNRS : UMR8146 – Université des Sciences et Technologies de Lille - Lille I – Université Charles de Gaulle - Lille III – Ecole Centrale de Lille
- Domaine : Informatique/Apprentissage
- Mots-clés : supervised learning – non linear function approximation – non parametric function approximation – kernel method – LARS – $l_1$ regularization
- Référence interne : RR-6794
- inria-00351930, version 1
- http://hal.inria.fr/inria-00351930
- oai:hal.inria.fr:inria-00351930
- Contributeur : Preux Philippe
- Soumis le : Lundi 12 Janvier 2009, 15:01:18
- Dernière modification le : Jeudi 16 Juin 2011, 12:42:35






Documents associés
Exporter