Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, Epiciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Beyond Moore-Penrose Part I: Generalized Inverses that Minimize Matrix Norms

Ivan Dokmanić 1 Rémi Gribonval 2 
2 PANAMA - Parcimonie et Nouveaux Algorithmes pour le Signal et la Modélisation Audio
Abstract : This is the first paper of a two-long series in which we study linear generalized inverses that minimize matrix norms. Such generalized inverses are famously represented by the Moore-Penrose pseudoinverse (MPP) which happens to minimize the Frobenius norm. Freeing up the degrees of freedom associated with Frobenius optimality enables us to promote other interesting properties. In this Part I, we look at the basic properties of norm-minimizing generalized inverses, especially in terms of uniqueness and relation to the MPP. We first show that the MPP minimizes many norms beyond those unitarily invariant, thus further bolstering its role as a robust choice in many situations. We then concentrate on some norms which are generally not minimized by the MPP, but whose minimization is relevant for linear inverse problems and sparse representations. In particular, we look at mixed norms and the induced $\ell^p \rightarrow \ell^q$ norms. An interesting representative is the sparse pseudoinverse which we study in much more detail in Part II. Next, we shift attention from norms to matrices with interesting behaviors. We exhibit a class whose generalized inverse is always the MPP—even for norms that normally result in different inverses—and a class for which many generalized inverses coincide, but not with the MPP. Finally, we discuss efficient computation of norm-minimizing generalized inverses.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

Cited literature [42 references]  Display  Hide  Download
Contributor : Rémi Gribonval Connect in order to contact the contributor
Submitted on : Thursday, July 13, 2017 - 11:26:28 PM
Last modification on : Friday, April 8, 2022 - 4:04:02 PM
Long-term archiving on: : Friday, January 26, 2018 - 7:54:26 PM



  • HAL Id : hal-01547183, version 2
  • ARXIV : 1706.08349


Ivan Dokmanić, Rémi Gribonval. Beyond Moore-Penrose Part I: Generalized Inverses that Minimize Matrix Norms. 2017. ⟨hal-01547183v2⟩



Record views


Files downloads