Research on Three-Dimensional Extension of Barzilai-Borwein-like Method

The Barzilai-Borwein (BB) method usually uses BB stepsize for iteration so as to eliminate the line search step in the steepest descent method. In this paper, we modify the BB stepsize and extend it to solve the optimization problems of three-dimensional quadratic functions. The discussion is divide...

Full description

Saved in:
Bibliographic Details
Main Authors: Tianji Wang, Qingdao Huang
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/13/2/215
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588039940997120
author Tianji Wang
Qingdao Huang
author_facet Tianji Wang
Qingdao Huang
author_sort Tianji Wang
collection DOAJ
description The Barzilai-Borwein (BB) method usually uses BB stepsize for iteration so as to eliminate the line search step in the steepest descent method. In this paper, we modify the BB stepsize and extend it to solve the optimization problems of three-dimensional quadratic functions. The discussion is divided into two cases. Firstly, we study the case where the coefficient matrix of the quadratic term of quadratic function is a special third-order diagonal matrix and prove that using the new modified stepsize, this case is <i>R</i>-superlinearly convergent. In addition to that, we extend it to <i>n</i>-dimensional case and prove the rate of convergence is <i>R</i>-linear. Secondly, we analyze that the coefficient matrix of the quadratic term of quadratic function is a third-order asymmetric matrix, that is, when the matrix has a double characteristic root and prove the global convergence of this case. The results of numerical experiments show that the modified method is effective for the above two cases.
format Article
id doaj-art-0f6ba0ca602c4c20b8bfc5f5c9a5c7c1
institution Kabale University
issn 2227-7390
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Mathematics
spelling doaj-art-0f6ba0ca602c4c20b8bfc5f5c9a5c7c12025-01-24T13:39:46ZengMDPI AGMathematics2227-73902025-01-0113221510.3390/math13020215Research on Three-Dimensional Extension of Barzilai-Borwein-like MethodTianji Wang0Qingdao Huang1School of Mathematics, Jilin University, Changchun 130012, ChinaSchool of Mathematics, Jilin University, Changchun 130012, ChinaThe Barzilai-Borwein (BB) method usually uses BB stepsize for iteration so as to eliminate the line search step in the steepest descent method. In this paper, we modify the BB stepsize and extend it to solve the optimization problems of three-dimensional quadratic functions. The discussion is divided into two cases. Firstly, we study the case where the coefficient matrix of the quadratic term of quadratic function is a special third-order diagonal matrix and prove that using the new modified stepsize, this case is <i>R</i>-superlinearly convergent. In addition to that, we extend it to <i>n</i>-dimensional case and prove the rate of convergence is <i>R</i>-linear. Secondly, we analyze that the coefficient matrix of the quadratic term of quadratic function is a third-order asymmetric matrix, that is, when the matrix has a double characteristic root and prove the global convergence of this case. The results of numerical experiments show that the modified method is effective for the above two cases.https://www.mdpi.com/2227-7390/13/2/215unconstrained optimizationquadratic functionsBarzilai-Borwein stepsizeR-superlinear convergenceglobal convergence
spellingShingle Tianji Wang
Qingdao Huang
Research on Three-Dimensional Extension of Barzilai-Borwein-like Method
Mathematics
unconstrained optimization
quadratic functions
Barzilai-Borwein stepsize
R-superlinear convergence
global convergence
title Research on Three-Dimensional Extension of Barzilai-Borwein-like Method
title_full Research on Three-Dimensional Extension of Barzilai-Borwein-like Method
title_fullStr Research on Three-Dimensional Extension of Barzilai-Borwein-like Method
title_full_unstemmed Research on Three-Dimensional Extension of Barzilai-Borwein-like Method
title_short Research on Three-Dimensional Extension of Barzilai-Borwein-like Method
title_sort research on three dimensional extension of barzilai borwein like method
topic unconstrained optimization
quadratic functions
Barzilai-Borwein stepsize
R-superlinear convergence
global convergence
url https://www.mdpi.com/2227-7390/13/2/215
work_keys_str_mv AT tianjiwang researchonthreedimensionalextensionofbarzilaiborweinlikemethod
AT qingdaohuang researchonthreedimensionalextensionofbarzilaiborweinlikemethod