XDvision: Dense outdoor perception for autonomous vehicles

Víctor Romero-Cano 1 Nicolas Vignard 2 Christian Laugier 1
1 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
Inria Grenoble - Rhône-Alpes, CITI - CITI Centre of Innovation in Telecommunications and Integration of services
Abstract : Robust perception is the cornerstone of safe and environmentally-aware autonomous navigation systems. Autonomous robots are expected to recognise the objects in their surroundings under a wide range of challenging environmental conditions. This problem has been tackled by combining multiple sensor modalities that have complementary characteristics. This paper proposes an approach to multi-sensor-based robotic perception that leverages the rich and dense appearance information provided by camera sensors, and the range data provided by active sensors independently of how dense their measurements are. We introduce a framework we call XDvision where colour images are augmented with dense depth information obtained from sparser sensors such as lidars. We demonstrate the utility of our framework by comparing the performance of a standard CNN-based image classifier fed with image data only with the performance of a two-layer multimodal CNN trained using our augmented representation.
Liste complète des métadonnées

Contributor : Christian Laugier <>
Submitted on : Saturday, December 23, 2017 - 11:05:01 AM
Last modification on : Wednesday, March 13, 2019 - 1:21:36 AM




Víctor Romero-Cano, Nicolas Vignard, Christian Laugier. XDvision: Dense outdoor perception for autonomous vehicles. IEEE Intelligent Vehicle conference 2017 (IV 2017), Jun 2017, Redondo Beach, Los Angeles, United States. ⟨10.1109/IVS.2017.7995807⟩. ⟨hal-01672089⟩



Record views