Pedestrian Recognition through Different Cross-Modality Deep Learning Methods

Abstract : A wide variety of approaches have been proposed for pedestrian detection in the last decay and it still remains an open challenge due to its outstanding importance in the field of automotive. In recent years, deep learning classification methods, in particular convolutional neural networks, combined with multi-modality images applied on different fusion schemes have achieved great performances in computer vision tasks. For the pedestrian recognition task, the late-fusion scheme outperforms the early and intermediate integration of modalities. In this paper, we focus on improving and optimizing the late-fusion scheme for pedestrian classification on the Daimler stereo vision data set. We propose different training methods based on Cross-Modality deep learning of Convolutional Neural Networks (CNNs): (1) a correlated model, (2) an incremental model and, (3) a particular cross-modality model, where each CNN is trained on one modality, but tested on a different one. The experiments show that the incremental cross-modality deep learning of CNNs achieves the best performances. It improves the classification performances not only for each modality classifier, but also for the multi-modality late-fusion scheme. The particular cross-modality model is a promising idea for automated annotation of modality images with a classifier trained on a different modality and/or for cross-dataset training.
Document type :
Conference papers
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.inria.fr/hal-01588441
Contributor : Danut Ovidiu Pop <>
Submitted on : Friday, September 15, 2017 - 4:26:33 PM
Last modification on : Thursday, February 7, 2019 - 5:37:28 PM
Long-term archiving on : Saturday, December 16, 2017 - 2:27:28 PM

File

ICVES.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01588441, version 1

Citation

Danut Ovidiu Pop, Alexandrina Rogozan, Fawzi Nashashibi, Abdelaziz Bensrhair. Pedestrian Recognition through Different Cross-Modality Deep Learning Methods. IEEE International Conference on Vehicular Electronics and Safety, Jun 2017, Vienna, Austria. ⟨hal-01588441⟩

Share

Metrics

Record views

461

Files downloads

274