Answers are grounded in this paper and cite their sources.
In a recent paper, Barzilai and Borwein presented a new choice of steplength for the gradient method. Their choice does not guarantee descent in the objective function and greatly speeds up the convergence of the method. They presented a convergence analysis of their method only in the two-dimensional quadratic case. We establish the convergence of the Barzilai and Borwein gradient method when applied to the minimization of a strictly convex quadratic function of any number of variables.
No takes yet. Share an insight, caveat, or question.
Marcos Raydan (1993) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: