Abstract
The paper concerns with the two numerical methods for approximating solutions of a monotone and Lipschitz variational inequality problem in a Hilbert space. We here describe how to incorporate regularization terms in the projection method, and then establish the strong convergence of the resulting methods under certain conditions imposed on regularization parameters. The new methods work in both cases of with or without knowing previously the Lipschitz constant of cost operator. Using the regularization aims mainly to obtain the strong convergence of the methods which is different to the known hybrid projection or viscosity-type methods. The effectiveness of the new methods over existing ones is also illustrated by several numerical experiments.
Similar content being viewed by others
References
Alber Ya I, Ryazantseva I (2006) Nonlinear Ill-posed problems of monotone type. Springer, Dordrecht
Anh PK, Buong Ng, Hieu DV (2014) Parallel methods for regularizing systems of equations involving accretive operators. Appl Anal 93:2136–2157
Bakushinskii AB (1977) Methods for solving monotonic variational inequalities based on the principle of iterative regularization. U.S.S. Comput Maths Math Phys 17:12–24
Censor Y, Gibali A, Reich S (2011) The subgradient extragradient method for solving variational inequalities in Hilbert space. J Optim Theory Appl 148:318–335
Censor Y, Gibali A, Reich S (2011) Strong convergence of subgradient extragradient methods for the variational inequality problem in Hilbert space. Optim Meth Softw 26:827–845
Censor Y, Gibali A, Reich S (2012) Extensions of Korpelevich’s extragradient method for the variational inequality problem in Euclidean space. Optimization 61:1119–1132
Cottle RW, Yao JC (1992) Pseudo-monotone complementarity problems in Hilbert space. J Optim Theory Appl 75:281–295
Facchinei F, Pang JS (2003) Finite-dimensional variational inequalities and complementarity Problems. Springer, Berlin
Goebel K, Reich S (1984) Uniform convexity, hyperbolic geometry, and nonexpansive Mappings. Marcel Dekker, New York and Basel
Hartman P, Stampacchia G (1966) On some non-linear elliptic differential-functional equations. Acta Math 115:271–310
Hieu DV, Anh PK, Muu LD (2019a) Modified extragradient-like algorithms with new stepsizes for variational inequalities. Comput Optim Appl 73:913–932
Hieu DV, Cho YJ, Xiao Y-B (2019b) Golden ratio algorithms with new stepsize rules for variational inequalities. Math Meth Appl Sci. https://doi.org/10.1002/mma.5703
Hieu DV, Cho YJ, Xiao Y-B, Kumam P (2019c) Relaxed extragradient algorithm for solving pseudomonotone variational inequalities in Hilbert spaces. Optimization. https://doi.org/10.1080/02331934.2019.1683554
Hieu DV, Cho YJ, Xiao YB (2019d) Modified accelerated algorithms for solving variational inequalities. Inter J Comput Math. https://doi.org/10.1080/00207160.2019.1686487
Khoroshilova EV (2013) Extragradient-type method for optimal control problem with linear constraints and convex objective function. Optim Lett 7:1193–1214
Kinderlehrer D, Stampacchia G (1980) An introduction to variational inequalities and their applications. Academic Press, New York
Konnov IV (2007) Equilibrium models and variational inequalities. Elsevier, Amsterdam
Korpelevich GM (1976) The extragradient method for finding saddle points and other problems. Ekonomikai Matematicheskie Metody 12:747–756
Kraikaew R, Saejung S (2014) Strong convergence of the Halpern subgradient extragradient method for solving variational inequalities in Hilbert spaces. J Optim Theory Appl 163:399–412
Maingé PE (2008) A hybrid extragradient-viscosity method for monotone operators and fixed point problems. SIAM J Control Optim 47:1499–1515
Malitsky YV (2015) Projected reflected gradient methods for monotone variational inequalities. SIAM J Optim 25:502–520
Malitsky YV (2019) Golden ratio algorithms for variational inequalities. Math Program. https://doi.org/10.1007/s10107-019-01416-w
Nadezhkina N, Takahashi W (2006) Strong convergence theorem by a hybrid method for nonexpansive mappings and Lipschitz-continuous monotone mappings. SIAM J Optim 16:1230–1241
Popov LD (1980) A modification of the Arrow–Hurwicz method for searching for saddle points. Mat Zametki 28:777–784
Seydenschwanz M (2015) Convergence results for the discrete regularization of linear-quadratic control problems with bang-bang solutions. Comput Optim Appl 629:731–760
Thong DV, Hieu DV (2019a) A strong convergence of modified subgradient extragradient method for solving bilevel pseudomonotone variational inequality problems. Optimization. https://doi.org/10.1080/02331934.2019.1686503
Thong DV, Hieu DV (2019b) Mann-type algorithms for variational inequality problems and fixed point problems. Optimization. https://doi.org/10.1080/02331934.2019.1692207
Tseng P (2000) A modified forward-backward splitting method for maximal monotone mappings. SIAM J Control Optim 38:431–446
Xu HK (2002) Another control condition in an iterative method for nonexpansive mappings. Bull Austral Math Soc 65:109–113
Xu HK (2011) Averaged mappings and the gradient-projection algorithm. J Optim Theory Appl 150:360–378
Yamada I (2001) The hybrid steepest descent method for the variational inequality problem over the intersection of fixed point sets of nonexpansive mappings. In: Butnariu D, Censor Y, Reich S (eds) Inherently parallel algorithms for feasibility and optimization and their applications. Elsevier, Amsterdam, pp 473–504
Zeng LC, Yao JC (2006) Strong convergence theorem by an extragradient method for fixed point problems and variational inequality problems. Taiwan J Math 10:1293–1303
Acknowledgements
The authors would like to thank the Associate Editor and the anonymous referees for their valuable comments and suggestions which helped us very much in improving the original version of this paper. This paper is supported by Vietnam National Foundation for Science and Technology Development (NAFOSTED) under Grant No. 101.01-2020.06.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There are no conflicts of interest to this work.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Van Hieu, D., Anh, P.K. & Muu, L.D. Strong convergence of subgradient extragradient method with regularization for solving variational inequalities. Optim Eng 22, 2575–2602 (2021). https://doi.org/10.1007/s11081-020-09540-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11081-020-09540-9