inria-00340725, version 1
Random Forests: some methodological insights
Robin Genuer
a, 1, 2Jean-Michel Poggi b, 1, 2Christine Tuleau c, 3
N° RR-6729 (2008)
Abstract: This paper examines from an experimental perspective random forests, the increasingly used statistical method for classification and regression problems introduced by Leo Breiman in 2001. It first aims at confirming, known but sparse, advice for using random forests and at proposing some complementary remarks for both standard problems as well as high dimensional ones for which the number of variables hugely exceeds the sample size. But the main contribution of this paper is twofold: to provide some insights about the behavior of the variable importance index based on random forests and in addition, to propose to investigate two classical issues of variable selection. The first one is to find important variables for interpretation and the second one is more restrictive and try to design a good prediction model. The strategy involves a ranking of explanatory variables using the random forests score of importance and a stepwise ascending variable introduction strategy.
- a – Université Paris Sud - Paris XI
- b – Université Paris Descartes - Paris V
- c – Université de Nice Sophia-Antipolis
- 1: Laboratoire de Mathématiques d'Orsay (LM-Orsay)
- CNRS : UMR8628 – Université Paris XI - Paris Sud
- 2: SELECT (INRIA Saclay - Ile de France)
- INRIA – Université Paris XI - Paris Sud – CNRS : UMR
- 3: Laboratoire Jean Alexandre Dieudonné (JAD)
- CNRS : UMR6621 – Université Nice Sophia Antipolis [UNS]
- Domain : Statistics/Machine Learning
Statistics/Statistics Theory
Mathematics/Statistics - Keywords : Random Forests – Regression – Classification – Variable Importance – Variable Selection
- Internal note : RR-6729
- inria-00340725, version 1
- http://hal.inria.fr/inria-00340725
- oai:hal.inria.fr:inria-00340725
- From: Robin Genuer
- Submitted on: Friday, 21 November 2008 17:12:30
- Updated on: Monday, 5 January 2009 12:07:48






Associated documents

Export