An evolutionary scheme for decision tree construction

Abstract : Classification is a central task in machine learning and data mining. Decision tree (DT) is one of the most popular learning models in data mining. The performance of a DT in a complex decision problem depends on the efficiency of its construction. However, obtaining the optimal DT is not a straightforward process. In this paper, we propose a new evolutionary meta-heuristic optimization based approach for identifying the best settings during the construction of a DT. We designed a genetic algorithm coupled with a multi-task objective function to pull out the optimal DT with the best parameters. This objective function is based on three main factors: (1) Precision over the test samples, (2) Trust in the construction and validation of a DT using the smallest possible training set and the largest possible testing set, and (3) Simplicity in terms of the size of the generated candidate DT, and the used set of attributes. We extensively evaluate our approach on 13 benchmark datasets and a fault diagnosis dataset. The results show that it outperforms classical DT construction methods in terms of accuracy and simplicity. They also show that the proposed approach outperforms Ant-Tree-Miner (an evolutionary DT construction approach), Naive Bayes and Support Vector Machine in terms of accuracy and F-measure.
Liste complète des métadonnées

Littérature citée [49 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01574079
Contributeur : Sabeur Aridhi <>
Soumis le : vendredi 11 août 2017 - 15:22:28
Dernière modification le : jeudi 11 janvier 2018 - 06:27:31

Fichier

Karabadji et al KBS 2017.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Nour El Islem Karabadji, Hassina Seridi, Fouad Bousetouane, Wajdi Dhifli, Sabeur Aridhi. An evolutionary scheme for decision tree construction. Knowledge-Based Systems, Elsevier, 2017, 119, pp.166 - 177. 〈10.1016/j.knosys.2016.12.011〉. 〈hal-01574079〉

Partager

Métriques

Consultations de la notice

79

Téléchargements de fichiers

37