HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

SAMBA: A Generic Framework for Secure Federated Multi-Armed Bandits

Radu Ciucanu 1 Pascal Lafourcade 2 Gael Marcadet 2 Marta Soare 1
1 LIG - Laboratoire d'Informatique de Grenoble
2 LIMOS - Laboratoire d'Informatique, de Modélisation et d'Optimisation des Systèmes
Abstract : The multi-armed bandit is a reinforcement learning model where a learning agent repeatedly chooses an action (pull a bandit arm) and the environment responds with a stochastic outcome (reward) coming from an unknown distribution associated with the chosen arm. Bandits have a wide-range of application such as Web recommendation systems. We address the cumulative reward maximization problem in a secure federated learning setting, where multiple data owners keep their data stored locally and collaborate under the coordination of a central orchestration server. We rely on cryptographic schemes and propose SAMBA, a generic framework for Secure federAted Multi-armed BAndits. Each data owner has data associated to a bandit arm and the bandit algorithm has to sequentially select which data owner is solicited at each time step. We instantiate SAMBA for five bandit algorithms. We show that SAMBA returns the same cumulative reward as the non-secure versions of bandit algorithms, while satisfying formally proven security properties. We also show that the overhead due to cryptographic primitives is linear in the size of the input, which is confirmed by our proof-of-concept implementation. https://www.jair.org/index.php/jair/article/view/13163
Keywords : distributed AI reinforcement learning machine learning
Document type :
Journal articles
Complete list of metadata
https://hal.inria.fr/hal-03553894
Contributor : Radu Ciucanu Connect in order to contact the contributor
Submitted on : Thursday, February 3, 2022 - 9:22:47 AM
Last modification on : Thursday, March 3, 2022 - 7:00:03 PM

Identifiers

  • HAL Id : hal-03553894, version 1

Collections

CLERMONT-AUVERGNE-INP | LIG_SIDCH | LIG | LIMOS | CNRS | PRES_CLERMONT | UGA

Citation

Radu Ciucanu, Pascal Lafourcade, Gael Marcadet, Marta Soare. SAMBA: A Generic Framework for Secure Federated Multi-Armed Bandits. Journal of Artificial Intelligence Research, Association for the Advancement of Artificial Intelligence, 2022, 73, pp.737--765. ⟨hal-03553894⟩

Export

BibTeX TEI DC DCterms EndNote Datacite

Share

Metrics

Record views

86

 

Contact                    Legal Notice                    Personal Data