Bayesian Credible Intervals for Online and Active Learning of Classification Trees - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Bayesian Credible Intervals for Online and Active Learning of Classification Trees

Résumé

—Classification trees have been extensively studied for decades. In the online learning scenario, a whole class of algorithms for decision trees has been introduced, called incremental decision trees. In the case where subtrees may not be discarded, an incremental decision tree can be seen as a sequential decision process, consisting in deciding to extend the existing tree or not. This problem involves an trade-off between exploration and exploitation, which is addressed in recent work with the use of Hoeffding's bounds. This paper proposes to use Bayesian Credible Intervals instead, in order to get the most out of the knowledge of the output's distribution's shape. It also studies the case of Active Learning in such a tree following the Optimism in the Face of Uncertainty paradigm. Two novel algorithms are introduced for the online and active learning problems. Evaluations on real-world datasets show that these algorithms compare positively to state-of-the-art.
Fichier principal
Vignette du fichier
ADPRL_2015_TCOP.pdf (290.9 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01225850 , version 1 (09-11-2015)

Identifiants

  • HAL Id : hal-01225850 , version 1

Citer

Timothé Collet, Olivier Pietquin. Bayesian Credible Intervals for Online and Active Learning of Classification Trees. ADPRL 2015 - Symposium on Adaptive Dynamic Programming and Reinforcement Learning., Dec 2015, Cape Town, South Africa. ⟨hal-01225850⟩
216 Consultations
158 Téléchargements

Partager

Gmail Facebook X LinkedIn More