Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Distributed Differentially Private Averaging with Improved Utility and Robustness to Malicious Parties

César Sabater 1 Aurélien Bellet 1 Jan Ramon 1
1 MAGNET - Machine Learning in Information Networks
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
Abstract : Learning from data owned by several parties, as in federated learning, raises challenges regarding the privacy guarantees provided to participants and the correctness of the computation in the presence of malicious parties. We tackle these challenges in the context of distributed averaging, an essential building block of distributed and federated learning. Our first contribution is a novel distributed differentially private protocol which naturally scales with the number of parties. The key idea underlying our protocol is to exchange correlated Gaussian noise along the edges of a network graph, complemented by independent noise added by each party. We analyze the differential privacy guarantees of our protocol and the impact of the graph topology, showing that we can match the accuracy of the trusted curator model even when each party communicates with only a logarithmic number of other parties chosen at random. This is in contrast with protocols in the local model of privacy (with lower accuracy) or based on secure aggregation (where all pairs of users need to exchange messages). Our second contribution is to enable users to prove the correctness of their computations without compromising the efficiency and privacy guarantees of the protocol. Our construction relies on standard cryptographic primitives like commitment schemes and zero knowledge proofs.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

https://hal.inria.fr/hal-03100019
Contributor : Aurélien Bellet <>
Submitted on : Wednesday, January 6, 2021 - 2:12:15 PM
Last modification on : Monday, January 25, 2021 - 3:37:40 PM

File

2006.07218.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03100019, version 1
  • ARXIV : 2006.07218

Citation

César Sabater, Aurélien Bellet, Jan Ramon. Distributed Differentially Private Averaging with Improved Utility and Robustness to Malicious Parties. 2020. ⟨hal-03100019⟩

Share

Metrics

Record views

22

Files downloads

71