P. Absil, R. Mahony, and R. Sepulchre, Optimization algorithms on matrix manifolds, 2009.
DOI : 10.1515/9781400830244

P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, Contour Detection and Hierarchical Image Segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.33, issue.5, pp.898-916, 2011.
DOI : 10.1109/TPAMI.2010.161

L. Bo, K. Lai, X. Ren, and D. Fox, Object recognition with hierarchical kernel descriptors, CVPR 2011, 2011.
DOI : 10.1109/CVPR.2011.5995719

D. S. Broomhead and D. Lowe, Radial basis functions, multi-variable functional interpolation and adaptive networks, 1988.

Y. Cho and L. K. Saul, Kernel methods for deep learning, Adv. NIPS, 2009.

A. Damianou and N. Lawrence, Deep Gaussian processes, Proc. AISTATS, 2013.

C. Dong, C. C. Loy, K. He, and X. Tang, Learning a Deep Convolutional Network for Image Super-Resolution, Proc. ECCV, 2014.
DOI : 10.1007/978-3-319-10593-2_13

C. Dong, C. C. Loy, K. He, and X. Tang, Image Super-Resolution Using Deep Convolutional Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.38, issue.2, pp.295-307, 2016.
DOI : 10.1109/TPAMI.2015.2439281

URL : http://arxiv.org/abs/1501.00092

K. He, X. Zhang, S. Ren, and J. Sun, Deep Residual Learning for Image Recognition, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
DOI : 10.1109/CVPR.2016.90

S. Ioffe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, Proc. ICML, 2015.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, Imagenet classification with deep convolutional neural networks, Adv. NIPS, 2012.

Y. Le-cun, L. Bottou, G. B. Orr, and K. Müller, Efficient backprop, Neural Networks, Tricks of the Trade, Lecture Notes in Computer Science LNCS 1524, 1998.

C. Lee, P. W. Gallagher, and Z. Tu, Generalizing pooling functions in convolutional neural networks: Mixed, gated, and tree, Proc. AISTATS, 2016.

C. Lee, S. Xie, P. W. Gallagher, Z. Zhang, and Z. Tu, Deeply-supervised nets, Proc. AISTATS, 2015.

H. Lin, J. Mairal, and Z. Harchaoui, A universal catalyst for first-order optimization, Adv. NIPS, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01160728

M. Lin, Q. Chen, and S. Yan, Network in network, Proc. ICLR, 2013.
URL : https://hal.archives-ouvertes.fr/hal-01460127

Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu et al., Reading digits in natural images with unsupervised feature learning, NIPS workshop on deep learning, 2011.

M. Paulin, M. Douze, Z. Harchaoui, J. Mairal, F. Perronin et al., Local Convolutional Features with Unsupervised Training for Image Retrieval, 2015 IEEE International Conference on Computer Vision (ICCV), 2015.
DOI : 10.1109/ICCV.2015.19

URL : https://hal.archives-ouvertes.fr/hal-01207966

A. Rahimi and B. Recht, Random features for large-scale kernel machines, Adv. NIPS, 2007.

B. Schölkopf and A. J. Smola, Learning with kernels: support vector machines, regularization, optimization, and beyond, 2002.

K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, Proc. ICLR, 2015.

S. Sonnenburg, G. Rätsch, C. Schäfer, and B. Schölkopf, Large scale multiple kernel learning, J. Mach. Learn. Res, vol.7, pp.1531-1565, 2006.

V. Sydorov, M. Sakurada, and C. Lampert, Deep Fisher Kernels -- End to End Learning of the Fisher Kernel GMM Parameters, 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014.
DOI : 10.1109/CVPR.2014.182

R. Timofte, V. Smet, and L. Van-gool, Anchored neighborhood regression for fast example-based superresolution, Proc. ICCV, 2013.

Z. Wang, D. Liu, J. Yang, W. Han, and T. Huang, Deep Networks for Image Super-Resolution with Sparse Prior, 2015 IEEE International Conference on Computer Vision (ICCV), 2015.
DOI : 10.1109/ICCV.2015.50

C. Williams and M. Seeger, Using the Nyström method to speed up kernel machines, Adv. NIPS, 2001.

M. D. Zeiler and R. Fergus, Stochastic pooling for regularization of deep convolutional neural networks, Proc. ICLR, 2013.

R. Zeyde, M. Elad, and M. Protter, On Single Image Scale-Up Using Sparse-Representations, Curves and Surfaces, pp.711-730, 2010.
DOI : 10.1007/978-3-642-27413-8_47

K. Zhang, I. W. Tsang, and J. T. Kwok, Improved Nyström low-rank approximation and error analysis, Proc. ICML, 2008.