Abstract
We introduce and develop a notion of “catastrophic radii” to identify where a minimization method may require an arbitrarily large number of steps to approximate a minimizer of an objective function, and we use this notion to categorize the performance of method/objective combinations. In order to investigate the different categories, we explore simple examples where explicit formulas can be used, and we discuss several ways that simulation can be used to investigate catastrophic radii for other method/objective combinations.
Similar content being viewed by others
References
Absil, P.-A., Kurdyka, K.: On the stable equilibrium points of gradient systems. Syst Control Lett 55, 573–577 (2006)
Asenjo, D., Stevenson, J.D., Wales, D.J., Frenkel, D.: Visualizing basins of attraction for different minimization algorithms. J. Phys. Chem. B 117, 12717–12723 (2013)
Blanchard, P., Devaney, R.L., Hall, G.R.: Differential equations, 4th edn. Brooks/Cole, Cengage Learning, Boston (2012)
Bosman, A.S., Engelbrecht, A., Helbig, M.: Visualising basins of attraction for the cross-entropy and the squared error neural network loss functions. arXiv:1901.02302 (2020)
Brzeski, P., Belardinelli, P., Lenci, S., Perlikowski, P.: Revealing compactness of basins of attraction of multi-DoF dynamical systems. Mech. Syst. Signal Process. 111, 348–361 (2018)
Danca, M.-F., Bourke, P., Kuznetsov, N.: Graphical structure of attraction basins of hidden chaotic attractors: The Rabinovich–Fabrikant system. Int. J. Bifurcation and Chaos 29, 1930001 (2020)
Daza, A., Wagemakers, A., Georgeot, B., Guéry-Odelin, D., Sanjuán, M.A.F.: Basin entropy: A new tool to analyze uncertainty in dynamical systems. Sci. Rep. 6, 31416 (2016)
Faghani, Z., Arab, Z., Parastesh, F., Jafari, S., Perc, M., Slavinec, M.: Effects of different initial conditions on the emergence of chimera states. Chaos Solitons Fract. 114, 306–311 (2018)
Haftka, R.T., Gürdal, Z.: Elements of structural optimization. 3rd rev. and expanded ed. Kluwer Academic Publishers, Amsterdam (1992)
Levy, A.B.: Attraction in numerical minimization. Springer briefs in optimization. Springer Nature Switzerland AG, Cham (2018)
Locatelli, M.: On the multilevel structure of global optimization problems. Comput. Optim. Appl. 30, 5–22 (2005)
Luersen, M.A., Le Riche, R.: Globalized Nelder–Mead method for engineering optimization. Comput. Struct. 82, 2251–2260 (2004)
Peitgen, H.-O., Jürgens, H., Saupe, D.: Chaos and fractals: New frontiers of science. Springer-Verlag, New York (1992)
Polyak, B.T.: Newton’s method and its use in optimization. Eur. J. Oper. Res. 181, 1086–1096 (2007)
Rockafellar, R.T., Wets, R.J.-B.: Variational analysis. Springer-Verlag, Berlin (1998)
Saha, A., Feudel, U.: Riddled basins of attraction in systems exhibiting extreme events. Chaos: An Interdisciplinary Journal of Nonlinear Science 28, 033610 (2018)
Sprott, J.C., Xiong, A.: Classifying and quantifying basins of attraction. Chaos 25, 083101 (2015)
Tsang, K.T.: Basin of attraction as a measure of robustness of an optimization algorithm. In: 14th international conference on natural computation fuzzy systems and knowledge discovery (ICNC-FSKD) (2018)
van Turnhout, M., Bociort, F.: Instabilities and fractal basins of attraction in optical system optimization. Opt. Express 17, 314–328 (2009)
Zotos, E.E.: Investigating the Newton-Raphson basins of attraction in the restricted three-body problem with modified Newtonian gravity. J. Appl. Math. Comput. 56, 53–71 (2018)
Zotos, E.E., Suraj, S. Md: Basins of attraction of equilibrium points in the planar circular restricted five-body problem. Astrophys. Space Sci. 363, 20 (2018)
Zotos, E.E., Suraj, S. Md, Mittal, A., Aggarwal, R.: Comparing the geometry of the basins of attraction, the speed and the efficiency of several numerical methods. Int. J. Appl. Comput. Math 4, 105 (2018)
Acknowledgments
I would like to thank the Referees and the Handling Editor for their very helpful comments that improved this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Levy, A.B. Categorizing with Catastrophic Radii in Numerical Minimization. Set-Valued Var. Anal 29, 1–28 (2021). https://doi.org/10.1007/s11228-020-00534-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11228-020-00534-4