High-Resolution Semantic Labeling with Convolutional Neural Networks

Emmanuel Maggiori 1 Yuliya Tarabalka 1 Guillaume Charpiat 2 Pierre Alliez 1
1 TITANE - Geometric Modeling of 3D Environments
CRISAM - Inria Sophia Antipolis - Méditerranée
2 TAU - TAckling the Underspeficied
Inria Saclay - Ile de France
Abstract : Convolutional neural networks (CNNs) have received increasing attention over the last few years. They were initially conceived for image categorization, i.e., the problem of assigning a semantic label to an entire input image. In this paper we address the problem of dense semantic labeling, which consists in assigning a semantic label to every pixel in an image. Since this requires a high spatial accuracy to determine where labels are assigned, categorization CNNs, intended to be highly robust to local deformations, are not directly applicable. By adapting categorization networks, many semantic labeling CNNs have been recently proposed. Our first contribution is an in-depth analysis of these architectures. We establish the desired properties of an ideal semantic labeling CNN, and assess how those methods stand with regard to these properties. We observe that even though they provide competitive results, these CNNs often underexploit properties of semantic labeling that could lead to more effective and efficient architectures. Out of these observations, we then derive a CNN framework specifically adapted to the semantic labeling problem. In addition to learning features at different resolutions, it learns how to combine these features. By integrating local and global information in an efficient and flexible manner, it outperforms previous techniques. We evaluate the proposed framework and compare it with state-of-the-art architectures on public benchmarks of high-resolution aerial image labeling.
Type de document :
Article dans une revue
IEEE Transactions on Geoscience and Remote Sensing, Institute of Electrical and Electronics Engineers, 2017
Liste complète des métadonnées

Littérature citée [31 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-01393279
Contributeur : Emmanuel Maggiori <>
Soumis le : mardi 14 mars 2017 - 09:57:23
Dernière modification le : jeudi 11 janvier 2018 - 16:17:50
Document(s) archivé(s) le : jeudi 15 juin 2017 - 12:52:41

Fichiers

Maggiori_HighResLabeling2016.p...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01393279, version 1
  • ARXIV : 1611.01962

Citation

Emmanuel Maggiori, Yuliya Tarabalka, Guillaume Charpiat, Pierre Alliez. High-Resolution Semantic Labeling with Convolutional Neural Networks. IEEE Transactions on Geoscience and Remote Sensing, Institute of Electrical and Electronics Engineers, 2017. 〈hal-01393279〉

Partager

Métriques

Consultations de la notice

673

Téléchargements de fichiers

428