Restricted Boltzmann Machine, recent advances and mean-field theory * - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Chinese Physics B Année : 2020

Restricted Boltzmann Machine, recent advances and mean-field theory *

Résumé

This review deals with Restricted Boltzmann Machine (RBM) under the light of statistical physics. The RBM is a classical family of Machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a Spin Glass model and exhibiting various links with other models of statistical physics, we gather recent results dealing with mean-field theory in this context. First the functioning of the RBM can be analyzed via the phase diagrams obtained for various statistical ensembles of RBM leading in particular to identify a compositional phase where a small number of features or modes are combined to form complex patterns. Then we discuss recent works either able to devise mean-field based learning algorithms; either able to reproduce generic aspects of the learning process from some ensemble dynamics equations or/and from linear stability arguments.
Fichier principal
Vignette du fichier
Decelle+et+al_2020_Chinese_Phys._B_10.1088_1674-1056_abd160.pdf (4.83 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03143314 , version 1 (16-02-2021)

Identifiants

Citer

Aurélien Decelle, Cyril Furtlehner. Restricted Boltzmann Machine, recent advances and mean-field theory *. Chinese Physics B, 2020, ⟨10.1088/1674-1056/abd160⟩. ⟨hal-03143314⟩
59 Consultations
207 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More