Abstract
In the context of simulation-based optimisation, this paper reviews recent work related to the role of metaheuristics, matheuristics (combinations of exact optimisation methods with metaheuristics), simheuristics (hybridisation of simulation with metaheuristics), biased-randomised heuristics for ‘agile’ optimisation via parallel computing, and learnheuristics (combination of statistical/machine learning with metaheuristics) to deal with NP-hard and large-scale optimisation problems in areas such as transport and logistics, manufacturing and production, smart cities, telecommunication networks, finance and insurance, sustainable energy consumption, health care, military and defence, e-marketing, or bioinformatics. The manuscript provides the main related concepts and updated references that illustrate the applications of these hybrid optimisation–simulation–learning approaches in solving rich and real-life challenges under dynamic and uncertainty scenarios. A numerical analysis is also included to illustrate the benefits that these approaches can offer across different application fields. Finally, this work concludes by highlighting open research lines on the combination of these methodologies to extend the concept of simulation-based optimisation.
Similar content being viewed by others
References
Almouhanna, A., Quintero-Araujo, C. L., Panadero, J., Juan, A. A., Khosravi, B., & Ouelhadj, D. (2020). The location routing problem using electric vehicles with constrained distance. Computers & Operations Research, 115, 104864.
Archetti, C., Bertazzi, L., Hertz, A., & Speranza, M. G. (2012). A hybrid heuristic for an inventory routing problem. INFORMS Journal on Computing, 24(1), 101–116.
Archetti, C., Boland, N., & Grazia Speranza, M. (2017). A matheuristic for the multivehicle inventory routing problem. INFORMS Journal on Computing, 29(3), 377–387.
Archetti, C., & Speranza, M. G. (2014). A survey on matheuristics for routing problems. EURO Journal on Computational Optimization, 2(4), 223–246.
Arnau, Q., Juan, A. A., & Serra, I. (2018). On the use of learnheuristics in vehicle routing optimization problems with dynamic inputs. Algorithms, 11(12), 208.
Balata, A., Ludkovski, M., Maheshwari, A., & Palczewski, J. (2019). Statistical learning for probability-constrained stochastic optimal control. arXiv preprint arXiv:1905.00107.
Bayliss, C., Juan, A. A., Currie, C. S., & Panadero, J. (2020). A learnheuristic approach for the team orienteering problem with aerial drone motion constraints. Applied Soft Computing, 92, 106280.
Bektaş, T., Gouveia, L., Martínez-Sykora, A., & Salazar-González, J.-J. (2019). Balanced vehicle routing: Polyhedral analysis and branch-and-cut algorithm. European Journal of Operational Research, 273(2), 452–463.
Belloso, J., Juan, A. A., & Faulin, J. (2019). An iterative biased-randomized heuristic for the fleet size and mix vehicle-routing problem with backhauls. International Transactions in Operational Research, 26(1), 289–301.
Bertsimas, D., & Kallus, N. (2020). From predictive to prescriptive analytics. Management Science, 66(3), 1025–1044.
Bertsimas, D., King, A., & Mazumder, R. (2016). Best subset selection via a modern optimization lens. The Annals of Statistics, 44(2), 813–852.
Bianchi, L., Birattari, M., Chiarandini, M., Manfrin, M., Mastrolilli, M., Paquete, L., Rossi-Doria, O., & Schiavinotto, T. (2004). Metaheuristics for the vehicle routing problem with stochastic demands. In X. Yao, E. Burke, J. A. Lozano, J. Smith, J. J. Merelo-Guervós, J. A. Bullinaria, J. Rowe, P. Tino, A. Kabán, & H.-P. Schwefel (Eds.), Proceedings of the 8th international conference PPSN VII (pp. 450–460). Springer.
Bianchi, L., Dorigo, M., Gambardella, L. M., & Gutjahr, W. J. (2009). A survey on metaheuristic for stochastic combinatorial optimization. Natural Computing, 8, 239–287.
Boschetti, M. A., Maniezzo, V., Roffilli, M., & Bolufé Röhler, A. (2009). Matheuristics: Optimization, simulation and control. In M. Blesa, C. Blum, L. Di Gaspero, A. Roli, M. Sampels, & A. Schaerf (Eds.), Hybrid metaheuristics, volume 5818 of lecture notes in computer science (pp. 171–177). Springer.
Brabazon, A., O’Neill, M., & McGarraghy, S. (2015). Natural computing algorithms (1st ed.). Springer.
Bramblett, L. M., Champagne, L. E., & Lunday, B. J. (2021). Parameterization and multiobjective optimization of range and loiter times for multiple-leg, turbojet aircraft mission profiles. Military Operations Research, 26(1), 37–58.
Cabrera, G., Juan, A. A., Lázaro, D., Marquès, J. M., & Proskurnia, I. (2014). A simulation–optimization approach to deploy internet services in large-scale systems with user-provided resources. Simulation, 90(6), 644–659.
Calvet, L., de Armas, J., Masip, D., & Juan, A. A. (2017). Learnheuristics: Hybridizing metaheuristics with machine learning for optimization with dynamic inputs. Open Mathematics, 15(1), 261–280.
Calvet, L., Ferrer, A., Gomes, M. I., Juan, A. A., & Masip, D. (2016). Combining statistical learning with metaheuristics for the multi-depot vehicle routing problem with market segmentation. Computers & Industrial Engineering, 94, 93–104.
Carroll, P., & Keenan, P. (2019). Chapter 10—Decision making using exact optimization methods in sustainable transportation. In J. Faulin, S. E. Grasman, A. A. Juan, & P. Hirsch (Eds.), Sustainable transportation and smart logistics (pp. 263–283). Elsevier.
Cerulli, R., Raiconi, A., & Voß, S. (2018). Computational logistics. Springer.
Chaudry, N., Vermedal, I., Fagerholt, K., Fauske, M. F., & Stålhane, M. (2020). A decomposition solution approach to the troops-to-tasks assignment in military peacekeeping operations. The Journal of Defense Modeling and Simulation, 17(4), 357–371.
Chen, S., & Wang, C. (2019). Incorporating a Bayesian network into two-stage stochastic programming for blood bank location-inventory problem in case of disasters. Discrete Dynamics in Nature and Society, 2019, 7214907.
Chica, M., Juan, A. A., Bayliss, C., Cordon, O., & Kelton, D. W. (2020). Why simheuristics? Benefits, limitations, and best practices when combining metaheuristics with simulation. Statistics and Operations Research Transactions, 44(2), 311–334.
Choi, T. J., Togelius, J., & Cheong, Y.-G. (2019). A fast and efficient stochastic opposition-based learning for differential evolution in numerical optimization. arXiv preprint arXiv:1908.08011.
Corlu, C. G., de la Torre, R., Serrano-Hernandez, A., Juan, A. A., & Faulin, J. (2020). Optimizing energy consumption in transportation: Literature review, insights, and research opportunities. Energies, 13(5), 1115.
Corne, D., Dhaenens, C., & Jourdan, L. (2012). Synergies between operations research and data mining: The emerging use of multi-objective approaches. European Journal of Operational Research, 221(3), 469–479.
Crespo-Vazquez, J. L., Carrillo, C., Diaz-Dorado, E., Martinez-Lorenzo, J. A., & Noor-E-Alam, M. (2018). A machine learning based stochastic optimization framework for a wind and storage power plant participating in energy pool market. Applied Energy, 232, 341–357.
de Armas, J., Ferrer, A., Juan, A. A., & Lalla-Ruiz, E. (2018). Modeling and solving the non-smooth arc routing problem with realistic soft constraints. Expert Systems with Applications, 98, 205–220.
de Armas, J., Juan, A. A., Marquès, J. M., & Pedroso, J. P. (2017). Solving the deterministic and stochastic uncapacitated facility location problem: From a heuristic to a simheuristic. Journal of the Operational Research Society, 68(10), 1161–1176.
de Armas, J., Keenan, P., Juan, A. A., & McGarraghy, S. (2019). Solving large-scale time capacitated arc routing problems: From real-time heuristics to metaheuristics. Annals of Operations Research, 273(1), 135–162.
de Sousa Junior, W. T., Montevechi, J. A. B., de Carvalho Miranda, R., & Campos, A. T. (2019). Discrete simulation-based optimization methods for industrial engineering problems: A systematic literature review. Computers & Industrial Engineering, 128, 526–540.
Diarrassouba, I. (2017). On the complexity of the separation problem for rounded capacity inequalities. Discrete Optimization, 25, 86–104.
Doering, J., Kizys, R., Juan, A. A., Fitó, À., & Polat, O. (2019). Metaheuristics for rich portfolio optimisation and risk management: Current state and future trends. Operations Research Perspectives, 6, 100121. https://doi.org/10.1016/j.orp.2019.100121.
Donti, P. L., Amos, B. D., & Kolter, J. Z. (2017). Task-based end-to-end model learning in stochastic optimization. In NIPS’17: Proceedings of the 31st international conference on neural information processing systems (pp. 5490–5500). NIPS.
El Balghiti, O., Elmachtoub, A. N., Grigas, P., & Tewari, A. (2019). Generalization bounds in the predict-then-optimize framework. In H. Wallach, H. Larochelle, A. Beygelzimer, F. d’Alché Buc, E. Fox, & R. Garnett (Eds.), Advances in neural information processing systems (Vol. 32, pp. 14412–14421). Curran Associates, Inc.
Elshaer, R., & Awad, H. (2020). A taxonomic review of metaheuristic algorithms for solving the vehicle routing problem and its variants. Computers & Industrial Engineering, 140, 106242.
Evans, L. A., & Bae, K.-H. G. (2019). Us army performance appraisal policy analysis: A simulation optimization approach. The Journal of Defense Modeling and Simulation, 16(2), 191–205.
Ezugwu, A. E., Shukla, A. K., Nath, R., Akinyelu, A. A., Agushaka, J. O., Chiroma, H., & Muhuri, P. K. (2021). Metaheuristics: A comprehensive overview and classification along with bibliometric analysis. Artificial Intelligence Review.
Feo, T., & Resende, M. (1995). Greedy randomized adaptive search procedures. Journal of Global Optimization, 2, 1–27.
Fernandez, S. A., Juan, A. A., de Armas Adrián, J., e Silva, D. G., & Terrén, D. R. (2018). Metaheuristics in telecommunication systems: Network design, routing, and allocation problems. IEEE Systems Journal, 12(4), 3948–3957.
Ferone, D., Gruler, A., Festa, P., & Juan, A. A. (2019). Enhancing and extending the classical grasp framework with biased randomisation and simulation. Journal of the Operational Research Society, 70(8), 1362–1375.
Fikar, C., Juan, A. A., Martinez, E., & Hirsch, P. (2016). A discrete-event driven metaheuristic for dynamic home service routing with synchronised trip sharing. European Journal of Industrial Engineering, 10(3), 323–340.
Fischetti, M., & Fischetti, M. (2018). Matheuristics. In Handbook of heuristics (pp. 121–153). Springer.
Gambella, C., Ghaddar, B., & Naoum-Sawaya, J. (2020). Optimization problems for machine learning: A survey. European Journal of Operational Research.
Gendreau, M., Laporte, G., & Seguin, R. (1996). A tabu search heuristic for the vehicle routing problem with stochastic demands and customers. Operations Research, 44(3), 469–477.
Glover, F. (1986). Future paths for integer programming and links to artificial intelligence. Computers and Operations Research, 13, 533–547.
González-Martín, S., Juan, A. A., Riera, D., Castellà, Q., Muñoz, R., & Pérez, A. (2012). Development and assessment of the sharp and randsharp algorithms for the arc routing problem. AI Communications, 25(2), 173–189.
Gonzalez-Martin, S., Juan, A. A., Riera, D., Elizondo, M. G., & Ramos, J. J. (2018). A simheuristic algorithm for solving the arc routing problem with stochastic demands. Journal of Simulation, 12(1), 53–66.
González-Neira, E., & Montoya-Torres, J. (2019). A simheuristic for bi-objective stochastic permutation flow shop scheduling problem. Journal of Project Management, 4(2), 57–80.
González-Neira, E. M., Urrego-Torres, A. M., Cruz-Riveros, A. M., Henao-Garcia, C., Montoya-Torres, J. R., Molina-Sánchez, L. P., Jimenez, J.-F. (2019). Robust solutions in multi-objective stochastic permutation flow shop problem. Computers & Industrial Engineering, 137, 106026.
Gosavi, A. (2015). Simulation-based optimization. Springer.
Grasas, A., Juan, A. A., Faulin, J., de Armas, J., & Ramalhinho, H. (2017). Biased randomization of heuristics using skewed probability distributions: A survey and some applications. Computers & Industrial Engineering, 110, 216–228.
Grasas, A., Juan, A. A., & Lourenço, H. R. (2016). SimILS: A simulation-based extension of the iterated local search metaheuristic for stochastic combinatorial optimization. Journal of Simulation, 10(1), 69–77.
Gruler, A., Panadero, J., de Armas, J., Moreno, J. A., & Juan, A. A. (2018). Combining variable neighborhood search with simulation for the inventory routing problem with stochastic demands and stock-outs. Computers & Industrial Engineering, 123, 278–288.
Gruler, A., Panadero, J., de Armas, J., Moreno, J. A., & Juan, A. A. (2020). A variable neighborhood search simheuristic for the multiperiod inventory routing problem with stochastic demands. International Transactions in Operational Research, 27(1), 314–335.
Gruler, A., Quintero-Araújo, C. L., Calvet, L., & Juan, A. A. (2017). Waste collection under uncertainty: A simheuristic based on variable neighbourhood search. European Journal of Industrial Engineering, 11(2), 228–255.
Guimarans, D., Dominguez, O., Panadero, J., & Juan, A. A. (2018). A simheuristic approach for the two-dimensional vehicle routing problem with stochastic travel times. Simulation Modelling Practice and Theory, 89, 1–14.
Hatami, S., Calvet, L., Fernández-Viagas, V., Framiñán, J. M., & Juan, A. A. (2018). A simheuristic algorithm to set up starting times in the stochastic parallel flowshop problem. Simulation Modelling Practice and Theory, 86, 55–71.
Holland, J. (1975). Adaptation in natural and artificial systems. University of Michigan Press.
Juan, A. A., Barrios, B. B., Vallada, E., Riera, D., & Jorba, J. (2014). A simheuristic algorithm for solving the permutation flow shop problem with stochastic processing times. Simulation Modelling Practice and Theory, 46, 101–117.
Juan, A. A., Faulin, J., Jorba, J., Caceres, J., & Marquès, J. (2013). Using parallel and distributed computing for real-time solving of vehicle routing problems with stochastic demands. Annals of Operations Research, 207(1), 43–65.
Juan, A. A., Faulin, J., Ruiz, R., Barrios, B., Gilibert, M., & Vilajosana, X. (2009). Using oriented random search to provide a set of alternative solutions to the capacitated vehicle routing problem. In Operations research and cyber-infrastructure (pp. 331–345). Springer.
Juan, A. A., Kelton, W. D., Currie, C. S., & Faulin, J. (2018). Simheuristics applications: Dealing with uncertainty in logistics, transportation, and other supply chain areas. In Proceedings of the winter simulation conference (pp. 3048–3059). IEEE.
Keskin, M., & Çatay, B. (2018). A matheuristic method for the electric vehicle routing problem with time windows and fast chargers. Computers & Operations Research, 100, 172–188.
Kline, A., Ahner, D., & Hill, R. (2019). The weapon-target assignment problem. Computers & Operations Research, 105, 226–236.
Lam, C.-P., Masek, M., Kelly, L., Papasimeon, M., & Benke, L. (2019). A simheuristic approach for evolving agent behaviour in the exploration for novel combat tactics. Operations Research Perspectives, 6, 100123.
Latorre-Biel, J. I., Ferone, D., Juan, A. A., & Faulin, J. (2020). Combining simheuristics with petri nets for solving the stochastic vehicle routing problem with correlated demands. Expert Systems with Applications, 168, 114240.
Li, G., & Li, J. (2020). An improved tabu search algorithm for the stochastic vehicle routing problem with soft time windows. IEEE Access, 8, 158115–158124.
Liu, Q., Li, X., Liu, H., & Guo, Z. (2020). Multi-objective metaheuristics for discrete optimization problems: A review of the state-of-the-art. Applied Soft Computing, 93, 106382.
Mak, K., & Guo, Z. (2004). A genetic algorithm for vehicle routing problems with stochastic demand and soft time windows. In M. Jones, S. Patek, & B. Tawney (Eds.), Proceedings of the 2004 IEEE systems and information symposium (pp. 183–190). IEEE Press.
Martí, R., Pardalos, P., & Resende, M. (2018). Handbook of heuristics (3 volumes). Springer.
Martins, L. D. C., Corlu, C. G., de la Torre, R., Juan, A. A., & Masmoudi, M. A. (2021). Optimizing ride-sharing operations in smart sustainable cities: Challenges and the need for agile algorithms. Computers & Industrial Engineering, 153, 107080.
Martins, L. D. C., Hirsch, P., & Juan, A. A. (2020). Agile optimization of a two-echelon vehicle routing problem with pickup and delivery. International Transactions in Operational Research, 28, 201–221.
Mendoza, J. E., Rousseau, L.-M., & Villegas, J. G. (2016). A hybrid metaheuristic for the vehicle routing problem with stochastic demand and duration constraints. Journal of Heuristics, 22, 539–566.
Mosadegh, H., Ghomi, S. F., & Süer, G. A. (2020). Stochastic mixed-model assembly line sequencing problem: Mathematical modeling and q-learning based simulated annealing hyper-heuristics. European Journal of Operational Research, 282(2), 530–544.
Naddef, D., & Rinaldi, G. (2002). Branch-and-cut algorithms for the capacitated VRP. In The vehicle routing problem (pp. 53–84). SIAM.
Oliva, D., Copado, P., Hinojosa, S., Panadero, J., Riera, D., & Juan, A. A. (2020). Fuzzy simheuristics: Solving optimization problems under stochastic and uncertainty scenarios. Mathematics, 8(12), 2240.
Oliveira, B. B., Carravilla, M. A., & Oliveira, J. F. (2018). Integrating pricing and capacity decisions in car rental: A matheuristic approach. Operations Research Perspectives, 5, 334–356.
Pagès-Bernaus, A., Ramalhinho, H., Juan, A. A., & Calvet, L. (2019). Designing e-commerce supply chains: A stochastic facility-location approach. International Transactions in Operational Research, 26(2), 507–528.
Panadero, J., Doering, J., Kizys, R., Juan, A. A., & Fito, A. (2018). A variable neighborhood search simheuristic for project portfolio selection under uncertainty. Journal of Heuristics, 26, 1–23.
Panadero, J., Juan, A. A., Bayliss, C., & Currie, C. (2020). Maximising reward from a team of surveillance drones: A simheuristic approach to the stochastic team orienteering problem. European Journal of Industrial Engineering, 14(4), 485–516.
Penna, P. H. V., Subramanian, A., Ochi, L. S., Vidal, T., & Prins, C. (2019). A hybrid heuristic for a broad class of vehicle routing problems with heterogeneous fleet. Annals of Operations Research, 273(1), 5–74.
Puchinger, J., & Raidl, G. R. (2005). Combining metaheuristics and exact algorithms in combinatorial optimization: A survey and classification. Lecture Notes in Computer Science, 3562, 41–53.
Quintero-Araujo, C. L., Caballero-Villalobos, J. P., Juan, A. A., & Montoya-Torres, J. R. (2017). A biased-randomized metaheuristic for the capacitated location routing problem. International Transactions in Operational Research, 24(5), 1079–1098.
Quintero-Araujo, C. L., Gruler, A., Juan, A. A., & Faulin, J. (2019a). Using horizontal cooperation concepts in integrated routing and facility-location decisions. International Transactions in Operational Research, 26(2), 551–576.
Quintero-Araujo, C. L., Guimarans, D., & Juan, A. A. (2019b). A simheuristic algorithm for the capacitated location routing problem with stochastic demands. Journal of Simulation, 1–18. https://doi.org/10.1080/17477778.2019.1680262.
Rabbani, M., Heidari, R., & Yazdanparast, R. (2019). A stochastic multi-period industrial hazardous waste location-routing problem: Integrating NSGA-II and Monte Carlo simulation. European Journal of Operational Research, 272(3), 945–961.
Rabe, M., Deininger, M., & Juan, A. A. (2020). Speeding up computational times in simheuristics combining genetic algorithms with discrete-event simulation. Simulation Modelling Practice and Theory, 103, 102089.
Reyes-Rubiano, L., Ferone, D., Juan, A. A., & Faulin, J. (2019). A simheuristic for routing electric vehicles with limited driving ranges and stochastic travel times. Statistics and Operations Research Transactions, 1(1), 3–24.
Rossi, A., & Lanzetta, M. (2020). Integration of hybrid additive/subtractive manufacturing planning and scheduling by metaheuristics. Computers & Industrial Engineering, 144, 106428.
Rubio-Largo, Á., Vanneschi, L., Castelli, M., & Vega-Rodríguez, M. A. (2018). Multiobjective metaheuristic to design RNA sequences. IEEE Transactions on Evolutionary Computation, 23(1), 156–169.
Scheidegger, S., & Bilionis, I. (2019). Machine learning for high-dimensional dynamic stochastic economies. Journal of Computational Science, 33, 68–82.
Schermer, D., Moeini, M., & Wendt, O. (2019). A matheuristic for the vehicle routing problem with drones and its variants. Transportation Research Part C: Emerging Technologies, 106, 166–204.
Sun, S., Cao, Z., Zhu, H., & Zhao, J. (2020). A survey of optimization methods from a machine learning perspective. IEEE Transactions on Cybernetics, 50(8), 3668–3681.
Toutouh, J., & Alba, E. (2017). Parallel multi-objective metaheuristics for smart communications in vehicular networks. Soft Computing, 21(8), 1949–1961.
Türkşen, I. B. (1999). Type I and type II fuzzy system modeling. Fuzzy Sets and Systems, 106(1), 11–34.
Ünal, H. T., & Başçiftçi, F. (2020). Using evolutionary algorithms for the scheduling of aircrew on airborne early warning and control system. Defence Science Journal, 70(3), 240–248.
Vadseth, S. T., Andersson, H., & Stålhane, M. (2021). An iterative matheuristic for the inventory routing problem. Computers & Operations Research, 131, 105262.
Vidal, T., Laporte, G., & Matl, P. (2020). A concise guide to existing and emerging vehicle routing problem variants. European Journal of Operational Research, 286(2), 401–416.
Villarinho, P. A., Panadero, J., Pessoa, L. S., Juan, A. A., & Oliveira, F. L. C. (2021). A simheuristic algorithm for the stochastic permutation flow-shop problem with delivery dates and cumulative payoffs. International Transactions in Operational Research, 28(2), 716–737.
Ying, C.-S., Chow, A. H., & Chin, K.-S. (2020). An actor-critic deep reinforcement learning approach for metro train scheduling with rolling stock circulation under stochastic demand. Transportation Research Part B: Methodological, 140, 210–235.
Zhang, J., Zhan, Z., Lin, Y., Chen, N., Gong, Y., Zhong, J., Chung, H. S., Li, Y., & Shi, Y. (2011). Evolutionary computation meets machine learning: A survey. IEEE Computational Intelligence Magazine, 6(4), 68–75.
Acknowledgements
This work has been partially supported by the Spanish Ministry of Science (PID2019-111100RB-C21/AEI/10.13039/501100011033, RED2018-102642-T). In addition, we would like to thank the support provided by the Michael Smurfit Graduate Business School at University College Dublin.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Juan, A.A., Keenan, P., Martí, R. et al. A review of the role of heuristics in stochastic optimisation: from metaheuristics to learnheuristics. Ann Oper Res 320, 831–861 (2023). https://doi.org/10.1007/s10479-021-04142-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10479-021-04142-9