Wasserstein PAC-Bayes Learning: A Bridge Between Generalisation and Optimisation - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Wasserstein PAC-Bayes Learning: A Bridge Between Generalisation and Optimisation

Résumé

PAC-Bayes learning is an established framework to assess the generalisation ability of learning algorithm during the training phase. However, it remains challenging to know whether PAC-Bayes is useful to understand, before training, why the output of well-known algorithms generalise well. We positively answer this question by expanding the \emph{Wasserstein PAC-Bayes} framework, briefly introduced in \cite{amit2022ipm}. We provide new generalisation bounds exploiting geometric assumptions on the loss function. Using our framework, we prove, before any training, that the output of an algorithm from \citet{lambert2022variational} has a strong asymptotic generalisation ability. More precisely, we show that it is possible to incorporate optimisation results within a generalisation framework, building a bridge between PAC-Bayes and optimisation algorithms.
Fichier principal
Vignette du fichier
2304.07048.pdf (642.54 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04080080 , version 1 (24-04-2023)
hal-04080080 , version 2 (30-05-2023)

Identifiants

Citer

Maxime Haddouche, Benjamin Guedj. Wasserstein PAC-Bayes Learning: A Bridge Between Generalisation and Optimisation. 2023. ⟨hal-04080080v1⟩
37 Consultations
91 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More