Skip to main content

Advertisement

Log in

Self-adaptive multi-population genetic algorithms for dynamic resource allocation in shared hosting platforms

  • Published:
Genetic Programming and Evolvable Machines Aims and scope Submit manuscript

Abstract

This paper presents a self-adaptive multi-population approach based on genetic algorithm (GA) for solving dynamic resource allocation in shared hosting platforms. The proposed method, self-adaptive multi-population genetic algorithm (SAMPGA), is a multi-population GA strategy aimed at locating and tracking optima. This approach is based on preventing populations from searching in the same areas. Two adaptations to the basic approach are then proposed to further improve its performance. The first adapted algorithm, memory-based SAMPGA, is based on using explicit memory to store promising solutions and retrieve them upon detecting change in the environment. The second adapted algorithm, immigrants-based SAMPGA, is aimed at improving the technique used by SAMPGA to maintain a sustainable level of diversity needed for quick adaptation to the environmental changes. An extensive set of experiments is conducted on a variety of dynamic resource allocation scenarios, to evaluate the performance of the proposed approach. Results are also compared with those of self-organizing random immigrants GA using three well-known performance metrics. The experimental results indicate the effectiveness of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. B. Urgaonkar, P. Shenoy, T. Roscoe, Resource overbooking and application profiling in shared hosting platforms. SIGOPS Oper Syst Rev 36(SI), 239–254 (2002)

    Article  Google Scholar 

  2. P. Ruth, J. Rhee, D. Xu, R. Kennell, S. Goasguen, Autonomic live adaptation of virtual computational environments in a multi-domain infrastructure, in 2006 IEEE International Conference on Autonomic Computing (2006), pp. 5–14

  3. S.S. Manvi, G. Krishna Shyam, Resource management for infrastructure as a service (IaaS) in cloud computing: a survey. J. Netw. Comput. Appl. 41, 424–440 (2014)

    Article  Google Scholar 

  4. V.P. Anuradha, D. Sumathi, A survey on resource allocation strategies in cloud computing, in International Conference on Information Communication and Embedded Systems (ICICES2014) (2014), pp. 1–7

  5. M.R. Garey, D.S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness. (W. H. Freeman & Co., New York, NY, USA, 1990)

    MATH  Google Scholar 

  6. K. Shen, H. Tang, T. Yang, L. Chu, Integrated resource management for cluster-based internet services. SIGOPS Oper Syst Rev 36(SI), 225–238 (2002)

    Article  Google Scholar 

  7. A. Karve et al., Dynamic placement for clustered web applications, in Proceedings of the 15th International Conference on World Wide Web, New York, NY, USA (2006), pp. 595–604

  8. D. Carrera, M. Steinder, I. Whalley, J. Torres, E. Ayguade, Utility-based placement of dynamic web applications with fairness goals, in NOMS 20082008 IEEE Network Operations and Management Symposium (2008), pp. 9–16

  9. J. Rolia, A. Andrzejak, M. Arlitt, Automating enterprise application placement in resource utilities, in Proceedings 14th IFIP/IEEE International Workshop Distributed Systems: Operations and Management (DSOM ’03), (2003), pp. 118–129

  10. M. Bichler, T. Setzer, B. Speitkamp, Capacity planning for virtualized servers. Social Science Research Network, Rochester, NY, SSRN Scholarly Paper ID 1025862 (2007)

  11. A. Xiong, C. Xu, Energy efficient multiresource allocation of virtual machine based on PSO in cloud data center. Math. Probl. Eng. 2014, 816518 (2014)

    Google Scholar 

  12. Z. Zheng, R. Wang, H. Zhong, X. Zhang, An approach for cloud resource scheduling based on parallel genetic algorithm, in 2011 3rd International Conference on Computer Research and Development, vol. 2 (2011), pp. 444–447

  13. D. Gmach, J. Rolia, L. Cherkasova, G. Belrose, T. Turicchi, A. Kemper, An integrated approach to resource pool management: policies, efficiency and quality metrics, in 2008 IEEE International Conference on Dependable Systems and Networks With FTCS and DCC (DSN) (2008), pp. 326–335

  14. J.S. Chase, D.C. Anderson, P.N. Thakar, A.M. Vahdat, R.P. Doyle, Managing energy and server resources in hosting centers, in Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles, New York, NY, USA (2001), pp. 103–116

  15. C.T. Joseph, K. Chandrasekaran, R. Cyriac, A novel family genetic approach for virtual machine allocation. Procedia Comput. Sci. 46, 558–565 (2015)

    Article  Google Scholar 

  16. M. Aron, P. Druschel, W. Zwaenepoel, Cluster reserves: a mechanism for resource management in cluster-based network servers, in Proceedings of the 2000 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, New York, NY, USA (2000), pp. 90–101

  17. G. Pacifici, M. Spreitzer, A.N. Tantawi, A. Youssef, Performance management for cluster-based web services. IEEE J. Sel. Areas Commun. 23(12), 2333–2343 (2005)

    Article  Google Scholar 

  18. D. Kumar, B. Sahoo, B. Mondal, T. Mandal, A genetic algorithmic approach for energy efficient task consolidation in cloud computing. Int. J. Comput. Appl. 118(2), 1–6 (2015)

    Google Scholar 

  19. M. Stillwell, D. Schanzenbach, F. Vivien, H. Casanova, Resource allocation algorithms for virtualized service hosting platforms. J. Parallel Distrib. Comput. 70(9), 962–974 (2010)

    Article  MATH  Google Scholar 

  20. S. Ali, J.-K. Kim, H.J. Siegel, A.A. Maciejewski, Static heuristics for robust resource allocation of continuously executing applications. J. Parallel Distrib. Comput. 68(8), 1070–1080 (2008)

    Article  MATH  Google Scholar 

  21. H. Van Nguyen, F. Dang Tran, and J.-M. Menaud, Autonomic virtual resource management for service hosting platforms, in Proceedings of the 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing, Washington, DC, USA (2009), pp. 1–8

  22. M.A. Bender, S. Chakrabarti, S. Muthukrishnan, Flow and stretch metrics for scheduling continuous job streams. SODA 98, 270–279 (1998)

    MathSciNet  MATH  Google Scholar 

  23. T.T. Nguyen, S. Yang, J. Branke, Evolutionary dynamic optimization: a survey of the state of the art. Swarm Evol. Comput. 6, 1–24 (2012)

    Article  Google Scholar 

  24. H.G. Cobb, An investigation into the use of hypermutation as an adaptive operator in genetic algorithms having continuous, time-dependent nonstationary environments. Technical Report AIC-90-001, Naval Research Laboratory, Washington, USA (1990)

  25. F. Vavak, K.A. Jukes, T.C. Fogarty, Performance of a genetic algorithm with variable local search range relative to frequency of the environmental changes, in Proceedings of the 3rd Annual Conference on Genetic Programming, (1998), pp. 602–608

  26. F. Vavak, K. Jukes, T.C. Fogarty, Learning the local search range for genetic optimisation in nonstationary environments, in IEEE International Conference on Evolutionary Computation, 1997 (1997), pp. 355–360

  27. J.J. Grefenstette, Genetic algorithms for changing environments. PPSN 2, 137–144 (1992)

    Google Scholar 

  28. H.C. Andersen, An investigation into genetic algorithms, and the relationship between speciation and the tracking of optima in dynamic functions. Queensland Univ. Technol. Honours thesis, 1991

  29. R.W. Morrison, Designing evolutionary algorithms for dynamic environments. Ph.D. thesis, George Mason University, Fairfax, VA, USA, 2002

  30. J. Branke, T. Kaußler, C. Schmidth, H. Schmeck, A multi-population approach to dynamic optimization problems, in Proceedings of the 4th International Conference on Adaptive Computing in Design and Manufacturing, (2000), pp. 299–308

  31. F. Oppacher, M. Wineberg, The shifting balance genetic algorithm: improving the GA in a dynamic environment, in Proceedings of the 1st Annual Conference on Genetic and Evolutionary ComputationVolume 1, San Francisco, CA, USA (1999), pp. 504–510

  32. R.K. Ursem, Multinational GA optimization techniques in dynamics environments, in Genetic and Evolutionary Computation Conference (2000), pp. 19–26

  33. P. Barham et al., Xen and the art of virtualization, in Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, New York, NY, USA (2003), pp. 164–177

  34. M. Stillwell, F. Vivien, H. Casanova, Dynamic fractional resource scheduling for HPC workloads, in 2010 IEEE International Symposium on Parallel Distributed Processing (IPDPS) (2010), pp. 1–12

  35. M. Stillwell, D. Schanzenbach, F. Vivien, H. Casanova, Resource allocation using virtual clusters, in Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, Washington, DC, USA (2009), pp. 260–267

  36. T. Blackwell, Particle swarm optimization in dynamic environment, in Evolutionary Computation in Dynamic and Uncertain Environments, Studies in Computational Intelligence, ed. by S. Yang, Y.-S. Ong, Y. Jin (Springer-Verlag, NJ, USA, 2007), pp. 28–49

    Google Scholar 

  37. T. Blackwell, J. Branke, Multi-swarm optimization in dynamic environments, in Applications of Evolutionary Computing, ed. by G.R. Raidl et al., Lecture Notes in Computer Science (Springer-Verlag, Berlin, Germany, 2004), vol. 3005, pp. 489–500

    Google Scholar 

  38. K. Trojanowski, Z. Michalewicz, Evolutionary optimization in non-stationary environments. J. Comput. Sci. Technol. 1(2), 93–124 (2000)

    Google Scholar 

  39. S. Yang, H. Cheng, F. Wang, Genetic algorithms with immigrants and memory schemes for dynamic shortest path routing problems in mobile ad hoc networks. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 40(1), 52–63 (2010)

    Article  Google Scholar 

  40. J. Branke, H. Schmeck, Designing evolutionary algorithms for dynamic optimization problems, in Theory and Application of Evolutionary Computation: Recent Trends, ed. by S. Tsutsui, A. Ghosh (Springer-Verlag, Berlin, Germany, 2002), pp. 239–262

    Google Scholar 

  41. K. Trojanowski, Z. Michalewicz, Searching for optima in non-stationary environments, in Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), vol. 3 (1999), p. 1850

  42. A.E. Ranginkaman, J. Kazemi Kordestani, A. Rezvanian, M.R. Meybodi, A note on the paper ‘A multi-population harmony search algorithm with external archive for dynamic optimization problems’ by Turky and Abdullah. Inf. Sci. 288, 12–14 (2014)

    Article  Google Scholar 

  43. R. Tinós, S. Yang, A self-organizing random immigrants genetic algorithm for dynamic optimization problems. Genet. Program Evolvable Mach. 8(3), 255–286 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Azam Shirali.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 50 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shirali, A., Kazemi Kordestani, J. & Meybodi, M.R. Self-adaptive multi-population genetic algorithms for dynamic resource allocation in shared hosting platforms. Genet Program Evolvable Mach 19, 505–534 (2018). https://doi.org/10.1007/s10710-018-9326-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10710-018-9326-3

Keywords

Navigation