Skip to main content
Log in

Categorizing with Catastrophic Radii in Numerical Minimization

  • Published:
Set-Valued and Variational Analysis Aims and scope Submit manuscript

Abstract

We introduce and develop a notion of “catastrophic radii” to identify where a minimization method may require an arbitrarily large number of steps to approximate a minimizer of an objective function, and we use this notion to categorize the performance of method/objective combinations. In order to investigate the different categories, we explore simple examples where explicit formulas can be used, and we discuss several ways that simulation can be used to investigate catastrophic radii for other method/objective combinations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Absil, P.-A., Kurdyka, K.: On the stable equilibrium points of gradient systems. Syst Control Lett 55, 573–577 (2006)

    Article  MathSciNet  Google Scholar 

  2. Asenjo, D., Stevenson, J.D., Wales, D.J., Frenkel, D.: Visualizing basins of attraction for different minimization algorithms. J. Phys. Chem. B 117, 12717–12723 (2013)

    Article  Google Scholar 

  3. Blanchard, P., Devaney, R.L., Hall, G.R.: Differential equations, 4th edn. Brooks/Cole, Cengage Learning, Boston (2012)

    Google Scholar 

  4. Bosman, A.S., Engelbrecht, A., Helbig, M.: Visualising basins of attraction for the cross-entropy and the squared error neural network loss functions. arXiv:1901.02302 (2020)

  5. Brzeski, P., Belardinelli, P., Lenci, S., Perlikowski, P.: Revealing compactness of basins of attraction of multi-DoF dynamical systems. Mech. Syst. Signal Process. 111, 348–361 (2018)

    Article  Google Scholar 

  6. Danca, M.-F., Bourke, P., Kuznetsov, N.: Graphical structure of attraction basins of hidden chaotic attractors: The Rabinovich–Fabrikant system. Int. J. Bifurcation and Chaos 29, 1930001 (2020)

    Article  MathSciNet  Google Scholar 

  7. Daza, A., Wagemakers, A., Georgeot, B., Guéry-Odelin, D., Sanjuán, M.A.F.: Basin entropy: A new tool to analyze uncertainty in dynamical systems. Sci. Rep. 6, 31416 (2016)

    Article  Google Scholar 

  8. Faghani, Z., Arab, Z., Parastesh, F., Jafari, S., Perc, M., Slavinec, M.: Effects of different initial conditions on the emergence of chimera states. Chaos Solitons Fract. 114, 306–311 (2018)

    Article  MathSciNet  Google Scholar 

  9. Haftka, R.T., Gürdal, Z.: Elements of structural optimization. 3rd rev. and expanded ed. Kluwer Academic Publishers, Amsterdam (1992)

    Book  Google Scholar 

  10. Levy, A.B.: Attraction in numerical minimization. Springer briefs in optimization. Springer Nature Switzerland AG, Cham (2018)

  11. Locatelli, M.: On the multilevel structure of global optimization problems. Comput. Optim. Appl. 30, 5–22 (2005)

    Article  MathSciNet  Google Scholar 

  12. Luersen, M.A., Le Riche, R.: Globalized Nelder–Mead method for engineering optimization. Comput. Struct. 82, 2251–2260 (2004)

    Article  Google Scholar 

  13. Peitgen, H.-O., Jürgens, H., Saupe, D.: Chaos and fractals: New frontiers of science. Springer-Verlag, New York (1992)

    Book  Google Scholar 

  14. Polyak, B.T.: Newton’s method and its use in optimization. Eur. J. Oper. Res. 181, 1086–1096 (2007)

    Article  MathSciNet  Google Scholar 

  15. Rockafellar, R.T., Wets, R.J.-B.: Variational analysis. Springer-Verlag, Berlin (1998)

    Book  Google Scholar 

  16. Saha, A., Feudel, U.: Riddled basins of attraction in systems exhibiting extreme events. Chaos: An Interdisciplinary Journal of Nonlinear Science 28, 033610 (2018)

    Article  MathSciNet  Google Scholar 

  17. Sprott, J.C., Xiong, A.: Classifying and quantifying basins of attraction. Chaos 25, 083101 (2015)

    Article  MathSciNet  Google Scholar 

  18. Tsang, K.T.: Basin of attraction as a measure of robustness of an optimization algorithm. In: 14th international conference on natural computation fuzzy systems and knowledge discovery (ICNC-FSKD) (2018)

  19. van Turnhout, M., Bociort, F.: Instabilities and fractal basins of attraction in optical system optimization. Opt. Express 17, 314–328 (2009)

    Article  Google Scholar 

  20. Zotos, E.E.: Investigating the Newton-Raphson basins of attraction in the restricted three-body problem with modified Newtonian gravity. J. Appl. Math. Comput. 56, 53–71 (2018)

    Article  MathSciNet  Google Scholar 

  21. Zotos, E.E., Suraj, S. Md: Basins of attraction of equilibrium points in the planar circular restricted five-body problem. Astrophys. Space Sci. 363, 20 (2018)

    Article  MathSciNet  Google Scholar 

  22. Zotos, E.E., Suraj, S. Md, Mittal, A., Aggarwal, R.: Comparing the geometry of the basins of attraction, the speed and the efficiency of several numerical methods. Int. J. Appl. Comput. Math 4, 105 (2018)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

I would like to thank the Referees and the Handling Editor for their very helpful comments that improved this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Adam B. Levy.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Levy, A.B. Categorizing with Catastrophic Radii in Numerical Minimization. Set-Valued Var. Anal 29, 1–28 (2021). https://doi.org/10.1007/s11228-020-00534-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11228-020-00534-4

Keywords

Mathematics Subject Classification (2010)

Navigation