Pedestrian Recognition through Different Cross-Modality Deep Learning Methods

Abstract : A wide variety of approaches have been proposed for pedestrian detection in the last decay and it still remains an open challenge due to its outstanding importance in the field of automotive. In recent years, deep learning classification methods, in particular convolutional neural networks, combined with multi-modality images applied on different fusion schemes have achieved great performances in computer vision tasks. For the pedestrian recognition task, the late-fusion scheme outperforms the early and intermediate integration of modalities. In this paper, we focus on improving and optimizing the late-fusion scheme for pedestrian classification on the Daimler stereo vision data set. We propose different training methods based on Cross-Modality deep learning of Convolutional Neural Networks (CNNs): (1) a correlated model, (2) an incremental model and, (3) a particular cross-modality model, where each CNN is trained on one modality, but tested on a different one. The experiments show that the incremental cross-modality deep learning of CNNs achieves the best performances. It improves the classification performances not only for each modality classifier, but also for the multi-modality late-fusion scheme. The particular cross-modality model is a promising idea for automated annotation of modality images with a classifier trained on a different modality and/or for cross-dataset training.
Type de document :
Communication dans un congrès
IEEE International Conference on Vehicular Electronics and Safety, Jun 2017, Vienna, Austria
Liste complète des métadonnées

Littérature citée [17 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01588441
Contributeur : Danut Ovidiu Pop <>
Soumis le : vendredi 15 septembre 2017 - 16:26:33
Dernière modification le : mardi 23 janvier 2018 - 13:16:01
Document(s) archivé(s) le : samedi 16 décembre 2017 - 14:27:28

Fichier

ICVES.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01588441, version 1

Citation

Danut Ovidiu Pop, Alexandrina Rogozan, Fawzi Nashashibi, Abdelaziz Bensrhair. Pedestrian Recognition through Different Cross-Modality Deep Learning Methods. IEEE International Conference on Vehicular Electronics and Safety, Jun 2017, Vienna, Austria. 〈hal-01588441〉

Partager

Métriques

Consultations de la notice

141

Téléchargements de fichiers

76