Skip to Main content Skip to Navigation
Conference papers

On the Differential Privacy of Bayesian Inference

Zuhe Zhang 1, * Benjamin Rubinstein 1 Christos Dimitrakakis 2, 3, 4
* Corresponding author
2 SEQUEL - Sequential Learning
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
Abstract : We study how to communicate findings of Bayesian inference to third parties, while preserving the strong guarantee of differential privacy. Our main contributions are four different algorithms for private Bayesian inference on proba-bilistic graphical models. These include two mechanisms for adding noise to the Bayesian updates, either directly to the posterior parameters, or to their Fourier transform so as to preserve update consistency. We also utilise a recently introduced posterior sampling mechanism, for which we prove bounds for the specific but general case of discrete Bayesian networks; and we introduce a maximum-a-posteriori private mechanism. Our analysis includes utility and privacy bounds, with a novel focus on the influence of graph structure on privacy. Worked examples and experiments with Bayesian naïve Bayes and Bayesian linear regression illustrate the application of our mechanisms.
Complete list of metadata
Contributor : Zuhe Zhang Connect in order to contact the contributor
Submitted on : Monday, February 20, 2017 - 10:16:03 PM
Last modification on : Thursday, January 20, 2022 - 4:16:30 PM
Long-term archiving on: : Sunday, May 21, 2017 - 12:13:06 PM


Files produced by the author(s)


  • HAL Id : hal-01234215, version 2
  • ARXIV : 1512.06992


Zuhe Zhang, Benjamin Rubinstein, Christos Dimitrakakis. On the Differential Privacy of Bayesian Inference. AAAI 2016 - Thirtieth AAAI Conference on Artificial Intelligence, Feb 2016, Phoenix, Arizona, United States. ⟨hal-01234215v2⟩



Les métriques sont temporairement indisponibles