A PAC-Bayes bound for deterministic classifiers - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2022

A PAC-Bayes bound for deterministic classifiers

Résumé

We establish a disintegrated PAC-Bayesian bound, for classifiers that are trained via continuous-time (non-stochastic) gradient descent. Contrarily to what is standard in the PAC-Bayesian setting, our result applies to a training algorithm that is deterministic, conditioned on a random initialisation, without requiring any $\textit{de-randomisation}$ step. We provide a broad discussion of the main features of the bound that we propose, and we study analytically and empirically its behaviour on linear models, finding promising results.
Fichier principal
Vignette du fichier
2209.02525.pdf (727.81 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03815146 , version 1 (14-10-2022)

Identifiants

Citer

Eugenio Clerico, George Deligiannidis, Benjamin Guedj, Arnaud Doucet. A PAC-Bayes bound for deterministic classifiers. 2022. ⟨hal-03815146⟩
28 Consultations
37 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More