Skip to Main content Skip to Navigation
Journal articles

Bayesian Networks: a Non-Frequentist Approach for Parametrization, and a more Accurate Structural Complexity Measure

Sylvain Gelly 1 Olivier Teytaud 1
1 TANC - Algorithmic number theory for cryptology
Inria Saclay - Ile de France, LIX - Laboratoire d'informatique de l'École polytechnique [Palaiseau]
Abstract : The problem of calibrating relations from examples is a classical problem in learning theory. This problem has in particular been studied in the theory of empirical processes (providing asymptotic results), and through statistical learning theory. The application of learning theory to bayesian networks is still uncomplete and we propose a contribution, especially through the use of covering numbers. We deduce multiple corollaries, among which a non-frequentist approach for parameters learning and a score taking into account a measure of structural entropy that has never been taken into account before. We then investigate the algorithmic aspects of our theoretical solution, based on BFGS and adaptive refining of gradient calculus. Empirical results show the relevance of both the statistical results and the algorithmic solution.
Document type :
Journal articles
Complete list of metadata

Cited literature [31 references]  Display  Hide  Download

https://hal.inria.fr/inria-00112838
Contributor : Sylvain Gelly <>
Submitted on : Thursday, November 9, 2006 - 10:24:09 PM
Last modification on : Wednesday, March 27, 2019 - 4:41:29 PM
Long-term archiving on: : Thursday, September 20, 2012 - 2:35:43 PM

Identifiers

  • HAL Id : inria-00112838, version 1

Collections

Citation

Sylvain Gelly, Olivier Teytaud. Bayesian Networks: a Non-Frequentist Approach for Parametrization, and a more Accurate Structural Complexity Measure. Revue des Sciences et Technologies de l'Information - Série RIA : Revue d'Intelligence Artificielle, Lavoisier, 2006. ⟨inria-00112838⟩

Share

Metrics

Record views

353

Files downloads

231