Bayesian Network Structure Learning from Limited Datasets through Graph Evolution

Abstract : Bayesian networks are stochastic models, widely adopted to encode knowledge in several fields. One of the most interesting features of a Bayesian network is the possibility of learning its structure from a set of data, and subsequently use the resulting model to perform new predictions. Structure learning for such models is a NP-hard problem, for which the scientific community developed two main approaches: score-and-search metaheuristics, often evolutionary-based, and dependency-analysis deterministic algorithms, based on stochastic tests. State-of-the-art solutions have been presented in both domains, but all methodologies start from the assumption of having access to large sets of learning data available, often numbering thousands of samples. This is not the case for many real-world applications, especially in the food processing and research industry. This paper proposes an evolutionary approach to the Bayesian structure learning problem, specifically tailored for learning sets of limited size. Falling in the category of score-andsearch techniques, the methodology exploits an evolutionary algorithm able to work directly on graph structures, previously used for assembly language generation, and a scoring function based on the Akaike Information Criterion, a well-studied metric of stochastic model performance. Experimental results show that the approach is able to outperform a state-of-the-art dependency-analysis algorithm, providing better models for small datasets.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.inria.fr/hal-00757529
Contributor : Evelyne Lutton <>
Submitted on : Tuesday, November 27, 2012 - 10:59:01 AM
Last modification on : Tuesday, May 14, 2019 - 10:13:06 AM
Long-term archiving on: Thursday, February 28, 2013 - 3:42:48 AM

File

tonda.pdf
Files produced by the author(s)

Identifiers

Citation

Alberto Tonda, Evelyne Lutton, Romain Reuillon, Giovanni Squillero, Pierre-Henri Wuillemin. Bayesian Network Structure Learning from Limited Datasets through Graph Evolution. EuroGP 2012 - 15th European Conference on Genetic Programming, Apr 2012, Malaga, Spain. pp.254-265, ⟨10.1007/978-3-642-29139-5_22⟩. ⟨hal-00757529⟩

Share

Metrics

Record views

1023

Files downloads

1025