DeepGUM: Learning Deep Robust Regression with a Gaussian-Uniform Mixture Model

Stéphane Lathuilière 1, 2 Pablo Mesejo 1, 3 Xavier Alameda-Pineda 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : In this paper we address the problem of how to robustly train a Con-vNet for regression, or deep robust regression. Traditionally, deep regression employ the L2 loss function, known to be sensitive to outliers, i.e. samples that either lie at an abnormal distance away from the majority of the training samples, or that correspond to wrongly annotated targets. This means that, during back-propagation, outliers may bias the training process due to the high magnitude of their gradient. In this paper, we propose DeepGUM: a deep regression model that is robust to outliers thanks to the use of a Gaussian-uniform mixture model. We derive an optimization algorithm that alternates between the unsupervised detection of outliers using expectation-maximization, and the supervised training with cleaned samples using stochastic gradient descent. DeepGUM is able to adapt to a continuously evolving outlier distribution, avoiding to manually impose any threshold on the proportion of outliers in the training set. Extensive experimental evaluations on four different tasks (facial and fashion landmark detection, age and head pose estimation) lead us to conclude that our novel robust technique provides reliability in the presence of various types of noise and protection against a high percentage of outliers.
Type de document :
Communication dans un congrès
ECCV 2018 - European Conference on Computer Vision, Sep 2018, Munich, Germany. Springer, 11209, pp.205-221, Lecture Notes in Computer Science. 〈10.1007/978-3-030-01228-1_13〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01851511
Contributeur : Team Perception <>
Soumis le : lundi 30 juillet 2018 - 12:13:10
Dernière modification le : jeudi 7 février 2019 - 15:04:57
Document(s) archivé(s) le : mercredi 31 octobre 2018 - 13:47:02

Fichier

main.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Stéphane Lathuilière, Pablo Mesejo, Xavier Alameda-Pineda, Radu Horaud. DeepGUM: Learning Deep Robust Regression with a Gaussian-Uniform Mixture Model. ECCV 2018 - European Conference on Computer Vision, Sep 2018, Munich, Germany. Springer, 11209, pp.205-221, Lecture Notes in Computer Science. 〈10.1007/978-3-030-01228-1_13〉. 〈hal-01851511〉

Partager

Métriques

Consultations de la notice

365

Téléchargements de fichiers

158