Abstract
This paper studies the convergence properties of algorithms belonging to the class of self-scaling (SS) quasi-Newton methods for unconstrained optimization. This class depends on two parameters, say θk and τk, for which the choice τk = 1 gives the Broyden family of unscaled methods, where θk = 1 corresponds to the well known DFP method. We propose simple conditions on these parameters that give rise to global convergence with inexact line searches, for convex objective functions. The q-superlinear convergence is achieved if further restrictions on the scaling parameter are introduced. These convergence results are an extension of the known results for the unscaled methods. Because the scaling parameter is heavily restricted, we consider a subclass of SS methods which satisfies the required conditions. Although convergence for the unscaled methods with θk≥1 is still an open question, we show that the global and superlinear convergence for SS methods is possible and present, in particular, a new SS-DFP method.
Original language | English |
---|---|
Pages (from-to) | 191-203 |
Number of pages | 13 |
Journal | Computational Optimization and Applications |
Volume | 9 |
Issue number | 2 |
Publication status | Published - Feb 1998 |
ASJC Scopus subject areas
- Management Science and Operations Research
- Applied Mathematics
- Computational Mathematics
- Control and Optimization