Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Iterative label cleaning for transductive and semi-supervised few-shot learning

Abstract : Few-shot learning amounts to learning representations and acquiring knowledge such that novel tasks may be solved with both supervision and data being limited. Improved performance is possible by transductive inference, where the entire test set is available concurrently, and semi-supervised learning, where more unlabeled data is available. These problems are closely related because there is little or no adaptation of the representation in novel tasks. Focusing on these two settings, we introduce a new algorithm that leverages the manifold structure of the labeled and unlabeled data distribution to predict pseudo-labels, while balancing over classes and using the loss value distribution of a limited-capacity classifier to select the cleanest labels, iterately improving the quality of pseudo-labels. Our solution sets new state of the art on four benchmark datasets, namely \emph{mini}ImageNet, \emph{tiered}ImageNet, CUB and CIFAR-FS, while being robust over feature space pre-processing and the quantity of available data.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

https://hal.inria.fr/hal-03134253
Contributor : Yannis Avrithis Connect in order to contact the contributor
Submitted on : Monday, February 8, 2021 - 10:57:24 AM
Last modification on : Friday, January 21, 2022 - 3:20:01 AM
Long-term archiving on: : Sunday, May 9, 2021 - 6:29:24 PM

File

2012.07962.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03134253, version 1
  • ARXIV : 2012.07962

Citation

Michalis Lazarou, Yannis Avrithis, Tania Stathaki. Iterative label cleaning for transductive and semi-supervised few-shot learning. 2020. ⟨hal-03134253⟩

Share

Metrics

Les métriques sont temporairement indisponibles