Skip to Main content Skip to Navigation
New interface
Preprints, Working Papers, ...

Wavelets in the deep learning era

Abstract : Sparsity based methods, such as wavelets, have been state-of-the-art for more than 20 years for inverse problems before being overtaken by neural networks. In particular, U-nets have proven to be extremely effective. Their main ingredients are a highly non-linear processing, a massive learning made possible by the flourishing of optimization algorithms with the power of computers (GPU) and the use of large available datasets for training. It is far from obvious to say which of these three ingredients has the biggest impact on the performance. While the many stages of non-linearity are intrinsic to deep learning, the usage of learning with training data could also be exploited by sparsity based approaches. The aim of our study is to push the limits of sparsity to use, similarly to U-nets, massive learning and large datasets, and then to compare the results with U-nets. We present a new network architecture, called learnlets, which conserves the properties of sparsity based methods such as exact reconstruction and good generalization properties, while fostering the power of neural networks for learning and fast calculation. We evaluate the model on image denoising tasks. Our conclusion is that U-nets perform better than learnlets, while learnlets have better generalization properties.
Complete list of metadata
Contributor : Zaccharie Ramzi Connect in order to contact the contributor
Submitted on : Thursday, September 16, 2021 - 4:44:38 PM
Last modification on : Friday, August 5, 2022 - 12:01:30 PM
Long-term archiving on: : Friday, December 17, 2021 - 7:26:16 PM


Files produced by the author(s)


  • HAL Id : hal-03346892, version 1


Zaccharie Ramzi, Kevin Michalewicz, Jean-Luc Starck, Thomas Moreau, Philippe Ciuciu. Wavelets in the deep learning era. {date}. ⟨hal-03346892⟩



Record views


Files downloads