Forward Learning Convolutional Neural Network - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Forward Learning Convolutional Neural Network

Résumé

A conventional convolutional neural network (CNN) is trained by back-propagation (BP) from output layer to input layer through the entire network. In this paper, we propose a novel training approach such that CNN can be trained in forward way unit by unit. For example, we separate a CNN network with three convolutional layers into three units. Each unit contains one convolutional layer and will be trained one by one in sequence. Experiments shows that training can be restricted in local unit and processed one by one from input to output. In most cases, our novel feed forward approach has equal or better performance compared to the traditional approach. In the worst case, our novel feed forward approach is inferior to the traditional approach less than 5% accuracy. Our training approach also obtains benefits from transfer learning by setting different targets for middle units. As the full network back propagation is unnecessary, BP learning becomes more efficiently and least square method can be applied to speed learning. Our novel approach gives out a new focus on training methods of convolutional neural network.
Fichier principal
Vignette du fichier
473854_1_En_6_Chapter.pdf (964.26 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02197796 , version 1 (30-07-2019)

Licence

Paternité

Identifiants

Citer

Hong Hu, Xin Hong, Dan Yang Hou, Zhongzhi Shi. Forward Learning Convolutional Neural Network. 10th International Conference on Intelligent Information Processing (IIP), Oct 2018, Nanning, China. pp.51-61, ⟨10.1007/978-3-030-00828-4_6⟩. ⟨hal-02197796⟩
44 Consultations
108 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More