The Equi-Correlation Network: a New Kernelized-LARS with Automatic Kernel Parameters Tuning

Manuel Loth 1, 2 Philippe Preux 1, 2
2 SEQUEL - Sequential Learning
LIFL - Laboratoire d'Informatique Fondamentale de Lille, Inria Lille - Nord Europe, LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal
Abstract : Machine learning heavily relies on the ability to learn/approximate real functions. State variables, the perceptions, internal states, etc, of an agent are often represented as real numbers; grounded on them, the agent has to predict something, or act in some way. In this view, this outcome is a nonlinear function of the inputs. It is thus a very common task to fit a nonlinear function to observations, namely solving a regression problem. Among other approaches, the LARS is very appealing, for its nice theoretical properties, and actual efficiency to compute the whole $l_1$ regularization path of a supervised learning problem, along with the sparsity. In this paper, we consider the kernelized version of the LARS. In this setting, kernel functions generally have some parameters that have to be tuned. In this paper, we propose a new algorithm, the Equi-Correlation Network (ECON), which originality is that while computing the regularization path, ECON automatically tunes kernel hyper-parameters; thus, this opens the way to working with infinitely many kernel functions, from which, the most interesting are selected. Interestingly, our algorithm is still computationaly efficient, and provide state-of-the-art results on standard benchmarks, while lessening the hand-tuning burden.
Type de document :
Rapport
[Research Report] RR-6794, INRIA. 2008
Liste complète des métadonnées

https://hal.inria.fr/inria-00351930
Contributeur : Preux Philippe <>
Soumis le : lundi 12 janvier 2009 - 15:01:18
Dernière modification le : jeudi 11 janvier 2018 - 06:22:13
Document(s) archivé(s) le : jeudi 11 octobre 2012 - 15:44:42

Fichier

RR-6794.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00351930, version 1

Collections

Citation

Manuel Loth, Philippe Preux. The Equi-Correlation Network: a New Kernelized-LARS with Automatic Kernel Parameters Tuning. [Research Report] RR-6794, INRIA. 2008. 〈inria-00351930〉

Partager

Métriques

Consultations de la notice

368

Téléchargements de fichiers

146