Skip to main content
SpringerLink
Log in

Improved conjugate gradient method for nonlinear system of equations

  • Published:
Computational and Applied Mathematics Aims and scope Submit manuscript

Abstract

In this paper, we propose a hybrid conjugate gradient (CG) method based on the approach of convex combination of Fletcher–Reeves (FR) and Polak–Ribière–Polyak (PRP) parameters, and Quasi-Newton’s update. This is made possible by using self-scaling memory-less Broyden’s update together with a hybrid direction consisting of two CG parameters. However, an important property of the new algorithm is that, it generates a descent search direction via non-monotone type line search. The global convergence of the algorithm is established under appropriate conditions. Finally, numerical experiments on some benchmark test problems, demonstrate the effectiveness of the proposed algorithm over some existing alternatives.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Abubakar AB, Kumam P (2018) An improved three-term derivative-free method for solving nonlinear equations. Comput Appl Math 37(5):6760–6773

    Article  MathSciNet  Google Scholar 

  • Abubakar AB, Kumam P (2019) A descent Dai–Liao conjugate gradient method for nonlinear equations. Num Algorithms 81(1):197–210

    Article  MathSciNet  Google Scholar 

  • Andrei N (2008) Another hybrid conjugate gradient algorithm for unconstrained optimization. Num Algorithms 47(2):143–156

    Article  MathSciNet  Google Scholar 

  • Andrei N (2009) Hybrid conjugate gradient algorithm for unconstrained optimization. J Optim Theory Appl 141(2):249–264

    Article  MathSciNet  Google Scholar 

  • Broyden CG (1965) A class of methods for solving nonlinear simultaneous equations. Math Comput 19:577–593

    Article  MathSciNet  Google Scholar 

  • Cheng W (2009) A prp type method for systems of monotone equations. Math Comput Model 50(1):15–20. https://doi.org/10.1016/j.mcm.2009.04.007

    Article  MathSciNet  MATH  Google Scholar 

  • Dai YH, Yuan YX (2001) An efficient hybrid conjugate gradient method for unconstrained optimization. Ann Oper Res 103(1–4):33–47

    Article  MathSciNet  Google Scholar 

  • Dai Z, Zhu H (2020) A modified Hestenes–Stiefel-type derivative-free method for large-scale nonlinear monotone equations. Mathematics 8(2):168

    Article  Google Scholar 

  • Dai Z, Chen X, Wen F (2015) A modified perry’s conjugate gradient method-based derivative-free method for solving large-scale nonlinear monotone equations. Appl Math Comput 270:378–386. https://doi.org/10.1016/j.amc.2015.08.014

    Article  MathSciNet  MATH  Google Scholar 

  • Dai Z, Zhu H, Kang J (2021) New technical indicators and stock returns predictability. Int Rev Econ Financ 71:127–142. https://doi.org/10.1016/j.iref.2020.09.006

    Article  Google Scholar 

  • Dauda M, Mamat M, Waziri M, Ahmad F, Mohamad FS (2016) Inexact cg-method via sr1 update for solving systems of nonlinear equations. Far East J Math Sci 100(11):1787

    MATH  Google Scholar 

  • Dauda M, Mamat M, Mohamad FS, Magaji AS, Waziri M (2019a) Derivative free conjugate gradient method via broyden’s update for solving symmetric systems of nonlinear equations. J Phys Conf Ser IOP Publ 1366:012099

    Article  Google Scholar 

  • Dauda MK, Mamat M, Mohamed MA, Waziri MY (2019b) Improved quasi-newton method via sr1 update for solving symmetric systems of nonlinear equations. Malay J Fund Appl Sci 15(1):117–120

    Article  Google Scholar 

  • Dauda MK, Usman S, Ubale H, Mamat M (2019c) An alternative modified conjugate gradient coefficient for solving nonlinear system of equations. Open J Sci Technol 2(3):5–8

    Article  Google Scholar 

  • Dolan ED, Moré JJ (2002) Benchmarking optimization software with performance profiles. Math Program 91(2):201–213

    Article  MathSciNet  Google Scholar 

  • Fang X, Ni Q (2017) A new derivative-free conjugate gradient method for large-scale nonlinear systems of equations. Bull Aust Math Soc 95(3):500–511

    Article  MathSciNet  Google Scholar 

  • Fletcher R, Reeves CM (1964) Function minimization by conjugate gradients. Comput J 7(2):149–154

    Article  MathSciNet  Google Scholar 

  • Gilbert JC, Nocedal J (1992) Global convergence properties of conjugate gradient methods for optimization. SIAM J Optim 2(1):21–42. https://doi.org/10.1137/0802003

    Article  MathSciNet  MATH  Google Scholar 

  • Grippo L, Lampariello F, Lucidi S (1986) A nonmonotone line search technique for newton’s method. SIAM J Num Anal 23(4):707–716

    Article  MathSciNet  Google Scholar 

  • Hager WW, Zhang H (2006) A survey of nonlinear conjugate gradient methods. Pac J Optim 2(1):35–58

    MathSciNet  MATH  Google Scholar 

  • Halilu A, Waziri M (2017) A transformed double steplength method for for solving large-scale systems of nonlinear equations. J Num Math Stochastics 9(1):20–23

    MATH  Google Scholar 

  • Hu Y, Storey C (1991) Global convergence result for conjugate gradient methods. J Optim Theory Appl 71(2):399–405

    Article  MathSciNet  Google Scholar 

  • Li D, Fukushima M (1999) A globally and superlinearly convergent gauss-newton-based bfgs method for symmetric nonlinear equations. SIAM J Num Anal 37(1):152–172. https://doi.org/10.1137/S0036142998335704

    Article  MathSciNet  MATH  Google Scholar 

  • Li DH, Fukushima M (2000) A derivative-free line search and global convergence of Broyden-like method for nonlinear equations. Optim Methods Softw 13(3):181–201. https://doi.org/10.1080/10556780008805782

    Article  MathSciNet  MATH  Google Scholar 

  • Livieris IE, Pintelas P (2012) Globally convergent modified Perry’s conjugate gradient method. Appl Math Comput 218(18):9197–9207. https://doi.org/10.1016/j.amc.2012.02.076

    Article  MathSciNet  MATH  Google Scholar 

  • Livieris IE, Tampakas V, Pintelas P (2018) A descent hybrid conjugate gradient method based on the memoryless bfgs update. Num Algorithms 79(4):1169–1185

    Article  MathSciNet  Google Scholar 

  • Mohammad H, Abubakar AB (2020) A descent derivative-free algorithm for nonlinear monotone equations with convex constraints. RAIRO Oper Res 54(2):489–505

    Article  MathSciNet  Google Scholar 

  • Oren SS, Luenberger DG (1974) Self-scaling variable metric (ssvm) algorithms: Part i: Criteria and sufficient conditions for scaling a class of algorithms. Manag Sci 20(5):845–862

    Article  Google Scholar 

  • Perry A (1978) A modified conjugate gradient algorithm. Oper Res 26(6):1073–1078

    Article  MathSciNet  Google Scholar 

  • Polak E, Ribiere G (1969) Note sur la convergence de méthodes de directions conjuguées. ESAIM: Mathematical Modelling and Numerical Analysis-Modélisation Mathématique et Analyse Numérique 3(R1):35–43

  • Polyak BT (1969) The conjugate gradient method in extremal problems. USSR Comput Math Math Phys 9(4):94–112

    Article  Google Scholar 

  • Powell MJ (1984) Nonconvex minimization calculations and the conjugate gradient method. In: Numerical analysis, Springer, pp 122–141

  • Solodov MV, Svaiter BF (1998) A globally convergent inexact newton method for systems of monotone equations. In: Reformulation: nonsmooth. piecewise smooth, semismooth and smoothing methods. Springer, pp 355–369

  • Touati-Ahmed D, Storey C (1990) Efficient hybrid conjugate gradient techniques. J Optim Theory Appl 64(2):379–397

    Article  MathSciNet  Google Scholar 

  • Waziri M, Leong W, Hassan M, Monsi M (2010a) Jacobian computation-free newton method for systems of non-linear equations. J Num Math Stochastic 2(1):54–63

    MATH  Google Scholar 

  • Waziri M, Leong WJ, Hassan MA, Monsi M (2010b) A new newton’s method with diagonal Jacobian approximation for systems of nonlinear equations. J Math Stat 6(3):246–252

    Article  Google Scholar 

  • Waziri MY, Sabi’u J (2015) A derivative-free conjugate gradient method and its global convergence for solving symmetric nonlinear equations. Int J Math Math Sci

  • Yu G (2010) A derivative-free method for solving large-scale nonlinear systems of equations. J Ind Manag Optim 6(1):149

    MathSciNet  MATH  Google Scholar 

  • Yu G (2011) Nonmonotone spectral gradient-type methods for large-scale unconstrained optimization and nonlineari systems of equations. Pac J Optim 7(2):387–404

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mathematical Sciences, Faculty of Physical Sciences, Bayero University, Kano, Nigeria

    Mohammed Yusuf Waziri & Auwal Bala Abubakar

  2. Department of Sciences, School of Continuing Education, Bayero University, Kano, Nigeria

    Aliyu Yusuf

Authors
  1. Mohammed Yusuf Waziri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aliyu Yusuf
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Auwal Bala Abubakar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Yusuf Waziri.

Additional information

Communicated by Andreas Fischer.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Waziri, M.Y., Yusuf, A. & Abubakar, A.B. Improved conjugate gradient method for nonlinear system of equations. Comp. Appl. Math. 39, 321 (2020). https://doi.org/10.1007/s40314-020-01374-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s40314-020-01374-6

Keywords

Mathematics Subject Classification

Search

Navigation