A unifying framework for exact and approximate Bayesian inference - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2006

A unifying framework for exact and approximate Bayesian inference

Résumé

We present a unifying framework for exact and approximate inference in Bayesian networks. This framework has been used to design a general purpose Bayesian inference engine, called ``ProBT'', for probabilistic reasoning and incremental model construction. This paper is not intended to present ProBT but to describe its underlying algorithms for both exact and approximate inference problems. The main idea of the ProBT inference engine is to use ``probability expressions'' as basic bricks to build more complex probabilistic models incrementally. The numerical evaluation of these expressions is accomplished just-in-time. Indeed, a probability expression is a symbolic representation of an inferred distribution. Probability expressions are manipulated in the same way as numerical distributions, such as probability tables and standard parametric distributions. A probability expression is said to be an ``exact'' or an ``approximate'' depending on the inference method (exact or approximate) used to evaluate it. For exact inference, we describe the ``Successive Restrictions Algorithm'' (SRA). Given a target distribution, the goal of the SRA is to construct a symbolic evaluation tree by finding a corresponding sum/product ordering that takes into account the computational constraints of the application (computation time and/or memory size). The optimality considerations of the SRA are also discussed. For the approximate inference part, several approximation schemes and the corresponding algorithms are presented. An original algorithm called ``MCSEM'' (for Monte Carlo Simultaneous Estimation and Maximization) is proposed. This algorithm aims at solving the problem of maximizing a posteriori high-dimensional distributions containing (in the general case) high-dimensional integrals (or sums).
Fichier principal
Vignette du fichier
RR-5797.pdf (2.11 Mo) Télécharger le fichier
Loading...

Dates et versions

inria-00070226 , version 1 (19-05-2006)

Identifiants

  • HAL Id : inria-00070226 , version 1

Citer

Kamel Mekhnacha, Linda Smail, Juan-Manuel Ahuactzin, Pierre Bessière, Emmanuel Mazer. A unifying framework for exact and approximate Bayesian inference. [Research Report] RR-5797, INRIA. 2006, pp.44. ⟨inria-00070226⟩
337 Consultations
336 Téléchargements

Partager

Gmail Facebook X LinkedIn More