Iterative label cleaning for transductive and semi-supervised few-shot learning - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2020

Iterative label cleaning for transductive and semi-supervised few-shot learning

Résumé

Few-shot learning amounts to learning representations and acquiring knowledge such that novel tasks may be solved with both supervision and data being limited. Improved performance is possible by transductive inference, where the entire test set is available concurrently, and semi-supervised learning, where more unlabeled data is available. These problems are closely related because there is little or no adaptation of the representation in novel tasks. Focusing on these two settings, we introduce a new algorithm that leverages the manifold structure of the labeled and unlabeled data distribution to predict pseudo-labels, while balancing over classes and using the loss value distribution of a limited-capacity classifier to select the cleanest labels, iterately improving the quality of pseudo-labels. Our solution sets new state of the art on four benchmark datasets, namely \emph{mini}ImageNet, \emph{tiered}ImageNet, CUB and CIFAR-FS, while being robust over feature space pre-processing and the quantity of available data.
Fichier principal
Vignette du fichier
2012.07962.pdf (567.55 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03134253 , version 1 (08-02-2021)

Identifiants

Citer

Michalis Lazarou, Yannis Avrithis, Tania Stathaki. Iterative label cleaning for transductive and semi-supervised few-shot learning. 2020. ⟨hal-03134253⟩
39 Consultations
77 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More