Title: The Limited Memory Conjugate Gradient Method
Abstract: In theory, the successive gradients generated by the conjugate gradient method applied to a quadratic should be orthogonal. However, for some ill-conditioned problems, orthogonality is quickly lost due to rounding errors, and convergence is much slower than expected. A limited memory version of the nonlinear conjugate gradient method is developed. The memory is used to both detect the loss of orthogonality and to restore orthogonality. An implementation of the algorithm is presented based on the CG_DESCENT nonlinear conjugate gradient method. Limited memory CG_DESCENT (L-CG_DESCENT) possesses a global convergence property similar to that of the memoryless algorithm but has much better practical performance. Numerical comparisons to the limited memory BFGS method (L-BFGS) are given using the CUTEr test problems.
Publication Year: 2013
Publication Date: 2013-01-01
Language: en
Type: article
Indexed In: ['crossref']
Access and Citation
Cited By Count: 96
AI Researcher Chatbot
Get quick answers to your questions about the article from our AI researcher chatbot