Convolutional Neural Fabrics

Shreyas Saxena 1 Jakob Verbeek 1
1 Thoth - Apprentissage de modèles à partir de données massives
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann
Abstract : Despite the success of convolutional neural networks, selecting the optimal architecture for a given task remains an open problem. Instead of aiming to select a single optimal architecture, we propose a " fabric " that embeds an exponentially large number of CNN architectures. The fabric consists of a 3D trellis that connects response maps at different layers, scales, and channels with a sparse homogeneous local connectivity pattern. The only hyper-parameters of the model (nr. of channels and layers) are not critical for performance. While individual CNN architectures can be recovered as paths in the trellis, the trellis can in addition ensemble all embedded architectures together, sharing their weights where their paths overlap. The trellis parameters can be learned using standard methods based on back-propagation, at a cost that scales linearly in the fabric size. We present benchmark results competitive with the state of the art for image classification on MNIST and CIFAR10, and for semantic segmentation on the Part Labels dataset.
Document type :
Conference papers
Complete list of metadatas


https://hal.inria.fr/hal-01359150
Contributor : Thoth Team <>
Submitted on : Friday, September 9, 2016 - 9:45:51 AM
Last modification on : Monday, April 9, 2018 - 12:22:50 PM
Long-term archiving on : Saturday, December 10, 2016 - 12:41:57 PM

Files

FabNet_plus_supp.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01359150, version 1

Citation

Shreyas Saxena, Jakob Verbeek. Convolutional Neural Fabrics. Neural Information Processing Systems (NIPS), Dec 2016, Barcelona, Spain. ⟨hal-01359150v1⟩

Share

Metrics

Record views

375

Files downloads

280