Semantic Grid Estimation with a Hybrid Bayesian and Deep Neural Network Approach

Özgür Erkent 1 Christian Wolf 1, 2 Christian Laugier 1 David Sierra González 1 Victor Romero Cano 3
1 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
Inria Grenoble - Rhône-Alpes, CITI - CITI Centre of Innovation in Telecommunications and Integration of services
2 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : In an autonomous vehicle setting, we propose a method for the estimation of a semantic grid, i.e. a bird's eye grid centered on the car's position and aligned with its driving direction, which contains high-level semantic information about the environment and its actors. Each grid cell contains a semantic label with divers classes, as for instance {Road, Vegetation, Building, Pedestrian, Car. .. }. We propose a hybrid approach, which combines the advantages of two different methodologies: we use Deep Learning to perform semantic segmentation on monocular RGB images with supervised learning from labeled groundtruth data. We combine these segmentations with occupancy grids calculated from LIDAR data using a generative Bayesian particle filter. The fusion itself is carried out with a deep neural network, which learns to integrate geometric information from the LIDAR with semantic information from the RGB data. We tested our method on two datasets, namely the KITTI dataset, which is publicly available and widely used, and our own dataset obtained with our own platform, equipped with a LIDAR and various sensors. We largely outperform baselines which calculate the semantic grid either from the RGB image alone or from LIDAR output alone, showing the interest of this hybrid approach.
Type de document :
Communication dans un congrès
IROS 2018 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct 2018, Madrid, Spain. IEEE, pp.1-8
Liste complète des métadonnées

https://hal.inria.fr/hal-01881377
Contributeur : Ozgur Erkent <>
Soumis le : mardi 25 septembre 2018 - 17:54:26
Dernière modification le : mercredi 31 octobre 2018 - 12:24:25

Fichier

Erkent-2018-IROS.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01881377, version 1

Collections

Citation

Özgür Erkent, Christian Wolf, Christian Laugier, David Sierra González, Victor Romero Cano. Semantic Grid Estimation with a Hybrid Bayesian and Deep Neural Network Approach. IROS 2018 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Oct 2018, Madrid, Spain. IEEE, pp.1-8. 〈hal-01881377〉

Partager

Métriques

Consultations de la notice

334

Téléchargements de fichiers

260