Decentralized Collaborative Learning of Personalized Models over Networks

Paul Vanhaesebrouck 1 Aurélien Bellet 2, 1 Marc Tommasi 1, 3
1 MAGNET - Machine Learning in Information Networks
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
2 Inria - Institut National de Recherche en Informatique et en Automatique
3 Université de Lille
Abstract : We consider a set of learning agents in a col-laborative peer-to-peer network, where each agent learns a personalized model according to its own learning objective. The question addressed in this paper is: how can agents improve upon their locally trained model by communicating with other agents that have similar objectives? We introduce and analyze two asynchronous gossip algorithms running in a fully decentralized manner. Our first approach , inspired from label propagation, aims to smooth pre-trained local models over the network while accounting for the confidence that each agent has in its initial model. In our second approach, agents jointly learn and propagate their model by making iterative updates based on both their local dataset and the behavior of their neighbors. To optimize this challenging objective, our decentralized algorithm is based on ADMM.
Type de document :
Communication dans un congrès
International Conference on Artificial Intelligence and Statistics (AISTATS), Apr 2017, Fort Lauderdale, Florida., United States
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger
https://hal.inria.fr/hal-01533182
Contributeur : Team Magnet <>
Soumis le : mardi 6 juin 2017 - 09:29:21
Dernière modification le : mardi 3 juillet 2018 - 11:28:18
Document(s) archivé(s) le : jeudi 7 septembre 2017 - 12:32:31

Fichier

supplementary.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01533182, version 1
  • ARXIV : 1610.05202

Collections

INRIA | INRIA2017 | CRISTAL | CRISTAL-MAGNET | UNIV-LILLE3

Citation

Paul Vanhaesebrouck, Aurélien Bellet, Marc Tommasi. Decentralized Collaborative Learning of Personalized Models over Networks. International Conference on Artificial Intelligence and Statistics (AISTATS), Apr 2017, Fort Lauderdale, Florida., United States. 〈hal-01533182〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

423

Téléchargements de fichiers

272

Contact


archive-ouverte@inria.fr