Skip to Main content Skip to Navigation
Conference papers

Gossip Learning as a Decentralized Alternative to Federated Learning

Abstract : Federated learning is a distributed machine learning approach for computing models over data collected by edge devices. Most importantly, the data itself is not collected centrally, but a master-worker architecture is applied where a master node performs aggregation and the edge devices are the workers, not unlike the parameter server approach. Gossip learning also assumes that the data remains at the edge devices, but it requires no aggregation server or any central component. In this empirical study, we present a thorough comparison of the two approaches. We examine the aggregated cost of machine learning in both cases, considering also a compression technique applicable in both approaches. We apply a real churn trace as well collected over mobile phones, and we also experiment with different distributions of the training data over the devices. Surprisingly, gossip learning actually outperforms federated learning in all the scenarios where the training data are distributed uniformly over the nodes, and it performs comparably to federated learning overall.
Complete list of metadata

Cited literature [17 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Friday, October 18, 2019 - 9:48:09 AM
Last modification on : Tuesday, November 26, 2019 - 4:12:09 PM
Long-term archiving on: : Sunday, January 19, 2020 - 1:22:57 PM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



István Hegedűs, Gábor Danner, Márk Jelasity. Gossip Learning as a Decentralized Alternative to Federated Learning. 19th IFIP International Conference on Distributed Applications and Interoperable Systems (DAIS), Jun 2019, Kongens Lyngby, Denmark. pp.74-90, ⟨10.1007/978-3-030-22496-7_5⟩. ⟨hal-02319574⟩



Record views


Files downloads