28622 articles – 22133 references  [version française]

hal-00805705, version 1

Constrained Overcomplete Analysis Operator Learning for Cosparse Signal Modelling

Mehrdad Yaghoobi () 1, Sangnam Nam () a2, Rémi Gribonval (, http://www.irisa.fr/metiss/members/remi) 3, Mike E. Davies () 1

IEEE Transactions on Signal Processing 61, 9 (2013) 2341-2355

Abstract: We consider the problem of learning a low-dimensional signal model from a collection of training samples. The mainstream approach would be to learn an overcomplete dictionary to provide good approximations of the training samples using sparse synthesis coefficients. This famous sparse model has a less well known counterpart, in analysis form, called the cosparse analysis model. In this new model, signals are characterised by their parsimony in a transformed domain using an overcomplete (linear) analysis operator. We propose to learn an analysis operator from a training corpus using a constrained optimisation framework based on L1 optimisation. The reason for introducing a constraint in the optimisation framework is to exclude trivial solutions. Although there is no final answer here for which constraint is the most relevant constraint, we investigate some conventional constraints in the model adaptation field and use the uniformly normalised tight frame (UNTF) for this purpose. We then derive a practical learning algorithm, based on projected subgradients and Douglas-Rachford splitting technique, and demonstrate its ability to robustly recover a ground truth analysis operator, when provided with a clean training set, of sufficient size. We also find an analysis operator for images, using some noisy cosparse signals, which is indeed a more realistic experiment. As the derived optimisation problem is not a convex program, we often find a local minimum using such variational methods. Some local optimality conditions are derived for two different settings, providing preliminary theoretical support for the well-posedness of the learning problem under appropriate conditions.

  • a –  INRIA
  • 1:  Institute for Digital Communication Joint Research Institute for Signal & Image Processing School of Engineering and Electronics - University of Edinburgh
  • University of Edinburgh
  • 2:  METISS (INRIA - IRISA)
  • CNRS : UMR6074 – INRIA – Institut National des Sciences Appliquées (INSA) - Rennes – Université de Rennes 1
  • 3:  PANAMA (INRIA - IRISA)
  • INRIA – CNRS : UMR6074
  • Domain : Computer Science/Signal and Image Processing
    Engineering Sciences/Signal and Image processing
    Computer Science/Numerical Analysis
    Computer Science/Learning
    Mathematics/Numerical Analysis
  • Keywords : Adaptation models – Algorithm design and analysis – Analytical models – Dictionaries – Optimization – Training – Vectors – Analysis sparsity – cosparsity – dictionary learning – low-dimensional signal model – sparse representations
 
  • hal-00805705, version 1
  • oai:hal.inria.fr:hal-00805705
  • From: 
  • Submitted on: Thursday, 28 March 2013 16:22:22
  • Updated on: Friday, 12 April 2013 22:31:14