Random Forests with a Steepend Gini-Index Split Function and Feature Coherence Injection - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Random Forests with a Steepend Gini-Index Split Function and Feature Coherence Injection

Résumé

Although Random Forests (RFs) are an effective and scalable ensemble machine learning approach, they are highly dependent on the discriminative ability of the available individual features. Since most data mining problems occur in the context of pre-existing data, there is little room to choose the original input features. Individual RF decision trees follow a greedy algorithm that iteratively selects the feature with the highest potential for achieving subsample purity. Common heuristics for ranking this potential include the gini-index and information gain metrics. This study seeks to improve the effectiveness of RFs through an adapted gini-index splitting function and a feature engineering technique. Using a structured framework for comparative evaluation of RFs, the study demonstrates that the effectiveness of the proposed methods is comparable with conventional gini-index based RFs. Improvements in the minimum accuracy recorded over some UCI data sets, demonstrate the potential for a hybrid set of splitting functions.
Fichier principal
Vignette du fichier
487577_1_En_17_Chapter.pdf (769.48 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03266471 , version 1 (21-06-2021)

Licence

Paternité

Identifiants

Citer

Mandlenkosi Victor Gwetu, Jules-Raymond Tapamo, Serestina Viriri. Random Forests with a Steepend Gini-Index Split Function and Feature Coherence Injection. 2nd International Conference on Machine Learning for Networking (MLN), Dec 2019, Paris, France. pp.255-272, ⟨10.1007/978-3-030-45778-5_17⟩. ⟨hal-03266471⟩
49 Consultations
42 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More