Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs

Abstract : In this work we propose a structured prediction technique that combines the virtues of Gaussian Conditional Random Fields (G-CRF) with Deep Learning: (a) our structured prediction task has a unique global optimum that is obtained exactly from the solution of a linear system (b) the gradients of our model parameters are analytically computed using closed form expressions, in contrast to the memory-demanding contemporary deep structured prediction approaches that rely on back-propagation-through-time, (c) our pairwise terms do not have to be simple hand-crafted expressions, as in the line of works building on the DenseCRF, but can rather be ‘discovered’ from data through deep architectures, and (d) out system can trained in an end-to-end manner. Building on standard tools from numerical analysis we develop very efficient algorithms for inference and learning, as well as a customized technique adapted to the semantic segmentation task. This efficiency allows us to explore more sophisticated architectures for structured prediction in deep learning: we introduce multi-resolution architectures to couple information across scales in a joint optimization framework, yielding systematic improvements. We demonstrate the utility of our approach on the challenging VOC PASCAL 2012 image segmentation benchmark, showing substantial improvements over strong baselines.
Type de document :
Communication dans un congrès
European Conference on Computer Vision, Sep 2016, Amsterdam, Netherlands. 2016, 〈10.5244/C.29.187〉
Liste complète des métadonnées

Littérature citée [31 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01410872
Contributeur : Siddhartha Chandra <>
Soumis le : mardi 6 décembre 2016 - 18:00:33
Dernière modification le : vendredi 6 avril 2018 - 13:32:01
Document(s) archivé(s) le : lundi 20 mars 2017 - 17:34:04

Fichier

rtf.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Siddhartha Chandra, Iasonas Kokkinos. Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs. European Conference on Computer Vision, Sep 2016, Amsterdam, Netherlands. 2016, 〈10.5244/C.29.187〉. 〈hal-01410872〉

Partager

Métriques

Consultations de la notice

191

Téléchargements de fichiers

91