HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

Some Numerical Experiments on Scaling and Updating L-BFGS Diagonal Preconditioners

Fabrice Veersé 1 Didier Auroux 1
1 IDOPT - System identification and optimization in physics and environment
Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : UMR5527
Abstract : A numerical study is performed to assess the impact of different limited-memor- y BFGS (L-BFGS) diagonal preconditioner update formulae and scaling strategies on the minimization performance. The formulae studied are those of Gilbert and Lemaréchal (1989) and a generalized version of the recently proposed quasi-Cauchy formula of Zhu et al. (1999). The scaling strategies are those of Gilbert and Lemaréchal (1989) and a new approach that is proposed. This numerical study uses a large number of test problems from the MODULOPT, MINPACK-2 and CUTE collections. Some rather stringent criteria are used for the line-search and the convergence, and the minimization is often performed up to the point where no more progress is achievable. It is found that the quasi-Cauchy formula overall performs poorly and suffers from a tendency to generate search directions numerically orthogonal to the gradient one. The good performance and robustness of the scaled direct BFGS diagonal-preconditioner update formula proposed by Gilbert and Lemaréchal (1989) is confirmed by the results of our experiments. The direct BFGS formula with the new scaling approach proposed is found to be much less robust. However, it significantly outperforms all the other update formulae in some cases.
Document type :
Complete list of metadata

Contributor : Rapport de Recherche Inria Connect in order to contact the contributor
Submitted on : Wednesday, May 24, 2006 - 10:58:10 AM
Last modification on : Friday, February 4, 2022 - 3:19:51 AM
Long-term archiving on: : Sunday, April 4, 2010 - 11:23:00 PM


  • HAL Id : inria-00072798, version 1



Fabrice Veersé, Didier Auroux. Some Numerical Experiments on Scaling and Updating L-BFGS Diagonal Preconditioners. [Research Report] RR-3858, INRIA. 2000. ⟨inria-00072798⟩



Record views


Files downloads