Abstract
The prediction-based evolutionary algorithms are a recently developed branch of metaheuristic algorithms. The most notable feature of this kind of algorithms is the use of a certain prediction model to develop their reproduction operators for evolution. The linear least square fitting model, as a simplest and most widely used statistic model, is first introduced to construct a linear prediction evolution algorithm (LPE) in this paper. Firstly, the proposed LPE randomly selects three individuals from three consecutive populations, respectively, and then fits a line on each dimension of the three individuals by using the linear least square fitting model. Finally, LPE regards the line expression as its reproduction operator to generate the offspring individuals. LPE algorithm does not have any control parameters except for a population size. Its reproduction operator based on the linear least square fitting model holds solid mathematical foundation without any empirical coefficients, and is theoretically proven to be adaptive to the variation of population regions. The effectiveness of the proposed LPE is validated on CEC2014, CEC2017 benchmark functions and a comprehensive set of seven engineering design problems. The comparison experiments indicate that LPE is a competitive optimizer compared with other state-of-the-art algorithms.
Similar content being viewed by others
References
Dulebenets Maxim A (2020) An adaptive island evolutionary algorithm for the berth scheduling problem. Memet Comput 12(1):51–72
Muthuswamy S, Lam Sarah S (2011) Discrete particle swarm optimization for the team orienteering problem. Memet Comput 3(4):287–303
Holland JH et al (1975) Adaptation in natural and artificial systems. An introductory analysis with applications to biology, control and artificial intelligence. University of Michigan Press, Ann Arbor
Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359
Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220(4598):671–680
Rashedi E, Nezamabadi-Pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179(13):2232–2248
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, Perth, Australia, pp 1942–1948
Karaboga D, Basturk B (2007) A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J Glob Optim 39(3):459–471
Larrañaga P, Lozano JA (2001) Estimation of distribution algorithms: a new tool for evolutionary computation, vol 2. Springer Science & Business Media
Hansen N, Ostermeier A (1996) Adapting arbitrary normal mutation distributions in evolution strategies: the covariance matrix adaptation. In: Proceedings of IEEE international conference on evolutionary computation, pp 312–317. IEEE
Buche D, Schraudolph NN, Koumoutsakos P (2005) Accelerating evolutionary algorithms with Gaussian process fitness function models. IEEE Trans Syst Man Cybern Part C Appl Rev 35(2):183–194
Zhongbo H, Xinlin X, Qinghua S, Zhu H, Guo J (2020) Grey prediction evolution algorithm for global optimization. Appl Math Model 79:145–160
Hu Z, Gao C, Qinghua S (2021) A novel evolutionary algorithm based on even difference grey model. Expert Syst Appl 114898
Xinlin X, Zhongbo H, Qinghua S, Li Y, Dai J (2020) Multivariable grey prediction evolution algorithm: a new metaheuristic. Appl Soft Comput 89:106086
Gao C, Zhongbo H, Xiong Z, Qinghua S (2020) Grey prediction evolution algorithm based on accelerated even grey model. IEEE Access 8:107941–107957
Dai C, Zhongbo H, Li Z, Xiong Z, Qinghua S (2020) An improved grey prediction evolution algorithm based on topological opposition-based learning. IEEE Access 8:30745–30762
Zhongbo H, Li Z, Dai C, Xinlin X, Xiong Z, Qinghua S (2020) Multiobjective grey prediction evolution algorithm for environmental/economic dispatch problem. IEEE Access 8:84162–84176
Zhou T, Zhongbo H, Zhou Q, Yuan S (2021) A novel grey prediction evolution algorithm for multimodal multiobjective optimization. Eng Appl Artif Intell 100:104173
York D (1966) Least-squares fitting of a straight line. Can J Phys 44(5):1079–1086
Rao R (2016) Jaya: a simple and new optimization algorithm for solving constrained and unconstrained optimization problems. Int J Ind Eng Comput 7(1):19–34
Wang G-G (2018) Moth search algorithm: a bio-inspired metaheuristic algorithm for global optimization problems. Memet Comput 10(2):151–164
Liang J, Qu B, Suganthan PN (2013) Problem definitions and evaluation criteria for the CEC2014 special session and competition on single objective real-parameter numerical optimization. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, p 635
Awad NH , Ali MZ, Nagaratnam SP, Jing L, Boyang Q (2016) Problem definitions and evaluation criteria for the CEC2017 special session and competition on single objective bound constrained real-parameter numerical optimization. Technical Report
Zeng G-Q, Xie X-Q, Chen M-R, Weng J (2019) Adaptive population extremal optimization-based PID neural network for multivariable nonlinear control systems. Swarm Evol Comput 44:320–334
Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18
Price KV, Awad NH, Ali MZ, Suganthan PN (2018) Problem definitions and evaluation criteria for the 100-digit challenge special session and competition on single objective numerical optimization. In Technical Report. Nanyang Technological University
Askarzadeh A (2016) A novel metaheuristic method for solving constrained engineering optimization problems: crow search algorithm. Comput Struct 169:1–12
Jaberipour M, Khorram E (2010) Two improved harmony search algorithms for solving engineering optimization problems. Commun Nonlinear Sci Numer Simul 15(11):3316–3331
Zhang C, Lin Q, Gao L, Li X (2015) Backtracking search algorithm with three constraint handling methods for constrained optimization problems. Expert Syst Appl 42(21):7831–7845
Wang L, Li L (2010) An effective differential evolution with level comparison for constrained engineering design. Struct Multidiscip Optim 41(6):947–963
Liu H, Cai Z, Wang Y (2010) Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization. Appl Soft Comput 10(2):629–640
Zhang M, Luo W, Wang X (2008) Differential evolution with dynamic stochastic selection for constrained optimization. Inf Sci 178(15):3043–3074
Sadollah A, Bahreininejad A, Eskandar H, Hamdi M (2013) Mine blast algorithm: a new population based algorithm for solving constrained engineering optimization problems. Appl Soft Comput 13(5):2592–2612
Wang Y, Cai Z, Zhou Y, Fan Z (2009) Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique. Struct Multidiscip Optim 37(4):395–413
Baykasoğlu A, Ozsoydan FB (2015) Adaptive firefly algorithm with chaos for mechanical design optimization problems. Appl Soft Comput 36:152–164
Coello CAC (2000) Use of a self-adaptive penalty approach for engineering optimization problems. Comput Ind 41(2):113–127
Coello CA, Efrén CM, Mezura, (2002) Constraint-handling in genetic algorithms through the use of dominance-based tournament selection. Adv Eng Inf 16(3):193–203
He Q, Wang L (2007) An effective co-evolutionary particle swarm optimization for constrained engineering design problems. Eng Appl Artif Intell 20(1):89–99
He Q, Wang L (2007) A hybrid particle swarm optimization with a feasibility-based rule for constrained optimization. Appl Math Comput 186(2):1407–1422
Wang H, Zhongbo H, Sun Y, Qinghua S, Xia X (2019) A novel modified BSA inspired by species evolution rule and simulated annealing principle for constrained engineering optimization problems. Neural Comput Appl 31(8):4157–4184
Huang F, Wang L, He Q (2007) An effective co-evolutionary differential evolution for constrained optimization. Appl Math Comput 186(1):340–356
Mezuramontes E, Coello CAC, Jesús V (2006) Increasing successful offspring and diversity in differential evolution for engineering design. In: Proceedings of the seventh international conference on adaptive computing in design and manufacture (ACDM 2006), pp 131–139
Cuevas E, Cienfuegos M (2014) A new algorithm inspired in the behavior of the social-spider for constrained optimization. Expert Syst Appl 41(2):412–425
Ozsoydan FB, İ Gölcük. (2020) Cuckoo search algorithm with various walks. In: Applications of Cuckoo Search Algorithm and its Variants, pp 47–77. Springer
Civicioglu P (2013) Backtracking search optimization algorithm for numerical optimization problems. Appl Math Comput 219(15):8121–8144
Kanagaraj G, Ponnambalam SG, Gandomi AH (2015) Hybridizing cuckoo search with bio-inspired algorithms for constrained optimization problems. In: International conference on swarm, evolutionary, and memetic computing, pp 260–273. Springer
Akay B, Karaboga D (2012) Artificial bee colony algorithm for large-scale problems and engineering design optimization. J Intell Manuf 23(4):1001–1014
Mirjalili S (2015) Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowledge-Based Syst 89:228–249
Cheng M, Prayogo D (2014) Symbiotic organisms search: a new metaheuristic optimization algorithm. Comput Struct 139:98–112
Svanberg K (1987) The method of moving asymptotes-a new method for structural optimization. Int J Numer Methods Eng 24(2):359–373
Chickermane H, Gea H (1996) Structural optimization using a new local approximation method. Int J Numer Methods Eng 39(5):829–846
Mirjalili S, Seyed MM, Hatamlou A (2016) Multi-verse optimizer: a nature-inspired algorithm for global optimization. Neural Comput Appl 27(2):495–513
Xue Yu, Xue B, Zhang M (2019) Self-adaptive particle swarm optimization for large-scale feature selection in classification. ACM Trans Knowl Discov Data (TKDD) 13(5):1–27
Xinlin X, Zhongbo H, Qinghua S, Zenggang X (2018) Multiobjective collective decision optimization algorithm for economic emission dispatch problem. Complexity
Bing X, Mengjie Z, Browne Will N, Xin Y (2015) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626
Zhang Y, Gong D, Cheng J (2015) Multi-objective particle swarm optimization approach for cost-based feature selection in classification. IEEE/ACM Trans Comput Biol Bioinformatics 14(1):64–75
Acknowledgements
This work was supported in part by the State Key Laboratory of Biogeology and Enviromental Geology (China University of Geosciences, No. GBL21801), Hubei Key Laboratory of Transportation Internet of Things (No.WHUTIOT-2019001), the Hunan Natural Science Foundation Project( No. 2020JJ7007) and the National Nature Science Foundation of China (No. 61972136).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Supplementary Material
Matlab_Codes of this paper are be provided in https://github.com/Zhongbo-Hu/Prediction-Evolutionary-Algorithm-HOMEPAGE.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Gao, C., Hu, Z. & Tong, W. Linear prediction evolution algorithm: a simplest evolutionary optimizer. Memetic Comp. 13, 319–339 (2021). https://doi.org/10.1007/s12293-021-00340-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12293-021-00340-x