inria-00174077, version 1
Mutual information for the selection of relevant variables in spectrometric nonlinear modelling
Fabrice Rossi
1Amaury Lendasse
2Damien François
3Vincent Wertz
3Michel Verleysen 4
Chemometrics and Intelligent Laboratory Systems / I Mathematical Background Chemometrics Intell Lab Syst 80, 2 (2006) 215-226
Résumé : Data from spectrophotometers form vectors of a large number of exploitable variables. Building quantitative models using these variables most often requires using a smaller set of variables than the initial one. Indeed, a too large number of input variables to a model results in a too large number of parameters, leading to overfitting and poor generalization abilities. In this paper, we suggest the use of the mutual information measure to select variables from the initial set. The mutual information measures the information content in input variables with respect to the model output, without making any assumption on the model that will be used; it is thus suitable for nonlinear modelling. In addition, it leads to the selection of variables among the initial set, and not to linear or nonlinear combinations of them. Without decreasing the model performances compared to other variable projection methods, it allows therefore a greater interpretability of the results.
- 1 : AxIS (INRIA Rocquencourt / INRIA Sophia Antipolis)
- INRIA
- 2 : Laboratory of Computer and Information Science (CIS)
- Helsinki University of Technology
- 3 : Centre for Systems Engineering and Applied Mechanics (CSAM)
- Université Catholique de Louvain
- 4 : Dispositifs Intégrés et Circuits Electroniques Machine Learning Group (DICE - MLG)
- Université Catholique de Louvain
- Domaine : Chimie/Chemo-informatique
Informatique/Apprentissage
Informatique/Réseau de neurones
Mathématiques/Statistiques - Mots-clés : Chemometrics – Mutual information – Feature selection – LS-SVM – RBF
- inria-00174077, version 1
- http://hal.inria.fr/inria-00174077
- oai:hal.inria.fr:inria-00174077
- Contributeur : Fabrice Rossi
- Soumis le : Vendredi 21 Septembre 2007, 14:36:40
- Dernière modification le : Vendredi 21 Septembre 2007, 14:49:57






Documents associés
Exporter