Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

A Parsimonious Tour of Bayesian Model Uncertainty

Pierre-Alexandre Mattei 1, 2
1 MAASAI - Modèles et algorithmes pour l’intelligence artificielle
CRISAM - Inria Sophia Antipolis - Méditerranée , UNS - Université Nice Sophia Antipolis (... - 2019), JAD - Laboratoire Jean Alexandre Dieudonné, Laboratoire I3S - SPARKS - Scalable and Pervasive softwARe and Knowledge Systems
Abstract : Modern statistical software and machine learning libraries are enabling semi-automated statistical inference. Within this context, it appears easier and easier to try and fit many models to the data at hand, reversing thereby the Fisherian way of conducting science by collecting data after the scientific hypothesis (and hence the model) has been determined. The renewed goal of the statistician becomes to help the practitioner choose within such large and heterogeneous families of models, a task known as model selection. The Bayesian paradigm offers a systematized way of assessing this problem. This approach, launched by Harold Jeffreys in his 1935 book Theory of Probability, has witnessed a remarkable evolution in the last decades, that has brought about several new theoretical and methodological advances. Some of these recent developments are the focus of this survey, which tries to present a unifying perspective on work carried out by different communities. In particular, we focus on non-asymptotic out-of-sample performance of Bayesian model selection and averaging techniques, and draw connections with penalized maximum likelihood. We also describe recent extensions to wider classes of probabilistic frameworks including high-dimensional, unidentifiable, or likelihood-free models.
Complete list of metadata

https://hal.inria.fr/hal-03044295
Contributor : Pierre-Alexandre Mattei Connect in order to contact the contributor
Submitted on : Monday, December 7, 2020 - 5:13:31 PM
Last modification on : Friday, January 21, 2022 - 3:09:54 AM

Links full text

Identifiers

  • HAL Id : hal-03044295, version 1
  • ARXIV : 1902.05539

Collections

Citation

Pierre-Alexandre Mattei. A Parsimonious Tour of Bayesian Model Uncertainty. 2020. ⟨hal-03044295⟩

Share

Metrics

Les métriques sont temporairement indisponibles