PIDT: A Novel Decision Tree Algorithm Based on Parameterised Impurities and Statistical Pruning Approaches

Abstract : In the process of constructing a decision tree, the criteria for selecting the splitting attributes influence the performance of the model produced by the decision tree algorithm. The most well-known criteria such as Shannon entropy and Gini index, suffer from the lack of adaptability to the datasets. This paper presents novel splitting attribute selection criteria based on some families of parameterised impurities that we proposed here to be used in the construction of optimal decision trees. These criteria rely on families of strict concave functions that define the new generalised parameterised impurity measures which we applied in devising and implementing our PIDT novel decision tree algorithm. This paper proposes also the S-condition based on statistical permutation tests, whose purpose is to ensure that the reduction in impurity, or gain, for the selected attribute is statistically significant. We implemented the S-pruning procedure based on the S-condition, to prevent model overfitting. These methods were evaluated on a number of simulated and benchmark datasets. Experimental results suggest that by tuning the parameters of the impurity measures and by using our S-pruning method, we obtain better decision tree classifiers with the PIDT algorithm.
Document type :
Conference papers
Lazaros Iliadis; Ilias Maglogiannis; Vassilis Plagianakos. 14th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2018, Rhodes, Greece. Springer International Publishing, IFIP Advances in Information and Communication Technology, AICT-519, pp.273-284, 2018, Artificial Intelligence Applications and Innovations. 〈10.1007/978-3-319-92007-8_24〉
Liste complète des métadonnées

Cited literature [5 references]  Display  Hide  Download

https://hal.inria.fr/hal-01821078
Contributor : Hal Ifip <>
Submitted on : Friday, June 22, 2018 - 11:46:18 AM
Last modification on : Friday, June 22, 2018 - 12:00:35 PM
Document(s) archivé(s) le : Tuesday, September 25, 2018 - 10:18:12 AM

File

 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2021-01-01

Please log in to resquest access to the document

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Daniel Stamate, Wajdi Alghamdi, Daniel Stahl, Doina Logofatu, Alexander Zamyatin. PIDT: A Novel Decision Tree Algorithm Based on Parameterised Impurities and Statistical Pruning Approaches. Lazaros Iliadis; Ilias Maglogiannis; Vassilis Plagianakos. 14th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2018, Rhodes, Greece. Springer International Publishing, IFIP Advances in Information and Communication Technology, AICT-519, pp.273-284, 2018, Artificial Intelligence Applications and Innovations. 〈10.1007/978-3-319-92007-8_24〉. 〈hal-01821078〉

Share

Metrics

Record views

94