Abstract
This paper concerns saddle points of rational functions, under general constraints. Based on optimality conditions, we propose an algorithm for computing saddle points. It uses Lasserre’s hierarchy of semidefinite relaxation. The algorithm can get a saddle point if it exists, or it can detect its nonexistence if it does not. Numerical experiments show that the algorithm is efficient for computing saddle points of rational functions.
Similar content being viewed by others
References
Bertsekas, D., Nedić, A., Ozdaglar, A.: Convex Analysis and Optimization. Athena Scientific, Belmont (2003)
Benzi, M., Liesen, G.H.: Numerical solution of saddle point problems. Acta Numer. 14, 1–137 (2005)
Chen, Y., Lan, G., Ouyang, Y.: Optimal primal-dual methods for a class of saddle point problems. SIAM J. Optim. 24(4), 1779–1814 (2014)
Cox, B., Juditsky, A., Nemirovski, A.: Decomposition techniques for bilinear saddle point problems and variational inequalities with affine monotone operators. J. Optim. Theory Appl. 172(2), 402–435 (2017)
Demmel, J., Nie, J., Powers, V.: Representations of positive polynomials on non-compact semialgebraic sets via KKT ideals. J. Pure Appl. Algebra 209(1), 189–200 (2007)
Guo, F., Wang, L., Zhou, G.: Minimizing rational functions by exact Jacobian SDP relaxation applicable to finite sinjularities. J. Glob. Optim. 58(2), 261–284 (2014)
He, Y., Monteiro, R.: Accelerating block-decomposition first-order methods for solving composite saddle-point and two-player nash equilibrium problems. SIAM J. Optim. 25(4), 2182–2211 (2015)
Henrion, D., Lasserre, J., Loefberg, J.: GloptiPoly 3: moments, optimization and semidefinite programming. Optim. Methods Softw. 24(4–5), 761–779 (2009)
Jibetean, D., de Klerk, E.: Global optimization of rational functions: a semidefinite programming approach. Math. Program. Ser. A 106, 93–109 (2006)
Lasserre, J.: Global optimization with polynomials and the problem of moments. SIAM J. Optim. 11(3), 796–817 (2001)
Lasserre, J.: Introduction to Polynomial and Semi-algebraic Optimization. Cambridge University Press, Cambridge (2015)
Laurent, M.: Revisiting two theorems of Curto and Fialkow on moment matrices. Proc. AMS 133(10), 2965–2976 (2005)
Laurent, M.: Optimization over polynomials: selected topics. In: Proceedings of the International Congress of Mathematicians (2014)
Maistroskii, D.: Gradient methods for finding saddle points. Matekon 13, 3–22 (1977)
Monteiro, R., Svaiter, B.: Complexity of variants of Tseng’s modified F-B splitting and Korpelevich’s methods for hemivariational inequalities with applications to saddle-point and convex optimization problems. SIAM J. Optim. 21(4), 1688–1720 (2011)
Nedić, A., Ozdaglar, A.: Subgradient methods for saddle-point problems. J. Optim. Theory Appl. 142(1), 205–228 (2009)
Nemirovski, A.: Prox-method with rate of convergence O(1/t) for variational inequalities with Lipschitz continuous monotone operators and smooth convex–concave saddle point problems. SIAM J. Optim. 15(1), 229–251 (2004)
Nemirovski, A., Judin, D.B.: Cezare convergence of gradient method approximation of saddle points for convex–concave functions. Dokl. Akad. Nauk SSSR 239, 1056–1059 (1978)
Nie, J., Demmel, J., Gu, M.: Global minimization of rational functions and the nearest GCDs. J. Glob. Optim. 40(4), 697–718 (2008)
Nie, J., Ranestad, K.: Algebraic degree of polynomial optimization. SIAM J. Optim. 20(1), 485–502 (2009)
Nie, J., Yang, Z., Zhou, G.: The saddle point problem of polynomials. Preprint (2018). arXiv:1809.01218
Nie, J.: Certifying convergence of Lasserre’s hierarchy via flat truncation. Math. Program. Ser. A 142(1–2), 485–510 (2013)
Nie, J.: Polynomial optimization with real varieties. SIAM J. Optim. 23(3), 1634–1646 (2013)
Nie, J.: Linear optimization with cones of moments and nonnegative polynomials. Math. Program. 153, 247–274 (2015)
Nie, J.: Optimality conditions and finite convergence of Lasserre’s hierarchy. Math. Program. Ser. A 146(1–2), 97–121 (2014)
Nie, J.: Tight relaxations for polynomial optimization and lagrange multiplier expressions. Math. Program. (2018). https://doi.org/10.1007/s10107-018-1276-2
Von Nuemann, J.: Zur Theorie der Gesellschaftspiele. Math. Ann. 100, 295–320 (1928)
Parrilo, P.: Semidefinite programming relaxations for semialgebraic problems. Math. Program. Ser. B 96(2), 293–320 (2003)
Putinar, M.: Positive polynomials on compact semi-algebraic sets. Indiana Univ. Math. J. 42, 969–984 (1993)
Scheiderer, C.: Positivity and sums of squares: a guide to recent results. In: Putinar, M., Sullivant, S. (eds.) Emerging Applications of Algebraic Geometry. The IMA Volumes in Mathematics and Its Applications, vol. 149, pp. 271–324. Springer, New York (2009)
Schweighofer, M.: Optimization of polynomials on compact semialgebraic sets. SIAM J. Optim. 15(3), 805–825 (2005)
Sturm, J.: SeDuMi 1.02: a MATLAB toolbox for optimization over symmetric cones. Optim. Methods Softw. 11 & 12, 625–653 (1999)
Zabotin, I.: A subgradient method for finding a saddle point of a convex–concave function. Issled. Prikl. Mat. 15, 6–12 (1988)
Acknowledgements
The authors wish to thank the editors and reviewers for their valuable comments that have improved the paper. Guangming Zhou was partially supported by the NSFC Grant 11671342.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhou, G., Wang, Q. & Zhao, W. Saddle points of rational functions. Comput Optim Appl 75, 817–832 (2020). https://doi.org/10.1007/s10589-019-00141-6
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10589-019-00141-6