Skip to Main content Skip to Navigation
Conference papers

Gossip Learning as a Decentralized Alternative to Federated Learning

Abstract : Federated learning is a distributed machine learning approach for computing models over data collected by edge devices. Most importantly, the data itself is not collected centrally, but a master-worker architecture is applied where a master node performs aggregation and the edge devices are the workers, not unlike the parameter server approach. Gossip learning also assumes that the data remains at the edge devices, but it requires no aggregation server or any central component. In this empirical study, we present a thorough comparison of the two approaches. We examine the aggregated cost of machine learning in both cases, considering also a compression technique applicable in both approaches. We apply a real churn trace as well collected over mobile phones, and we also experiment with different distributions of the training data over the devices. Surprisingly, gossip learning actually outperforms federated learning in all the scenarios where the training data are distributed uniformly over the nodes, and it performs comparably to federated learning overall.
Complete list of metadata

Cited literature [17 references]  Display  Hide  Download

https://hal.inria.fr/hal-02319574
Contributor : Hal Ifip <>
Submitted on : Friday, October 18, 2019 - 9:48:09 AM
Last modification on : Tuesday, November 26, 2019 - 4:12:09 PM
Long-term archiving on: : Sunday, January 19, 2020 - 1:22:57 PM

File

 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2022-01-01

Please log in to resquest access to the document

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

István Hegedűs, Gábor Danner, Márk Jelasity. Gossip Learning as a Decentralized Alternative to Federated Learning. 19th IFIP International Conference on Distributed Applications and Interoperable Systems (DAIS), Jun 2019, Kongens Lyngby, Denmark. pp.74-90, ⟨10.1007/978-3-030-22496-7_5⟩. ⟨hal-02319574⟩

Share

Metrics

Record views

344