Minimax semi-supervised set-valued approach to multi-class classification - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Bernoulli Année : 2021

Minimax semi-supervised set-valued approach to multi-class classification

Résumé

We study supervised and semi-supervised algorithms in the set-valued classification framework with controlled expected size. While the former methods can use only n labeled samples, the latter are able to make use of N additional unlabeled data. We obtain semi-supervised minimax rates of convergence under the α-margin assumption and a β-Hölder condition on the conditional distribution of labels. Our analysis implies that if no further assumption is made, there is no supervised method that outperforms the semi-supervised estimator proposed in this work – the best achievable rate for any supervised method is O(n−1/2), even if the margin assumption is extremely favorable; on the contrary, the developed semi-supervised estimator can achieve faster O((n/logn)−(1+α)β/(2β+d)) rate of convergence provided that sufficiently many unlabeled samples are available. We also show that under additional smoothness assumption, supervised methods are able to achieve faster rates and the unlabeled sample cannot improve the rate of convergence. Finally, a numerical study supports our theory and emphasizes the relevance of the assumptions we required from an empirical perspective.
Fichier principal
Vignette du fichier
main.pdf (826.11 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02112918 , version 1 (27-04-2019)

Identifiants

Citer

Evgenii Chzhen, Christophe Denis, Mohamed Hebiri. Minimax semi-supervised set-valued approach to multi-class classification. Bernoulli, 2021, ⟨10.3150/20-BEJ1313⟩. ⟨hal-02112918⟩
556 Consultations
331 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More