HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Reports

Random Forests: some methodological insights

Abstract : This paper examines from an experimental perspective random forests, the increasingly used statistical method for classification and regression problems introduced by Leo Breiman in 2001. It first aims at confirming, known but sparse, advice for using random forests and at proposing some complementary remarks for both standard problems as well as high dimensional ones for which the number of variables hugely exceeds the sample size. But the main contribution of this paper is twofold: to provide some insights about the behavior of the variable importance index based on random forests and in addition, to propose to investigate two classical issues of variable selection. The first one is to find important variables for interpretation and the second one is more restrictive and try to design a good prediction model. The strategy involves a ranking of explanatory variables using the random forests score of importance and a stepwise ascending variable introduction strategy.
Complete list of metadata

Cited literature [39 references]  Display  Hide  Download

https://hal.inria.fr/inria-00340725
Contributor : Robin Genuer Connect in order to contact the contributor
Submitted on : Friday, November 21, 2008 - 5:12:30 PM
Last modification on : Thursday, January 20, 2022 - 4:13:18 PM
Long-term archiving on: : Monday, June 7, 2010 - 11:13:36 PM

Files

RR-6729.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00340725, version 1
  • ARXIV : 0811.3619

Citation

Robin Genuer, Jean-Michel Poggi, Christine Tuleau. Random Forests: some methodological insights. [Research Report] RR-6729, INRIA. 2008. ⟨inria-00340725⟩

Share

Metrics

Record views

708

Files downloads

740