Skip to main content

Advertisement

SpringerLink
Log in

Energy and quality of service-aware virtual machine consolidation in a cloud data center

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

The large-scale virtualized Cloud data centers consume huge amount of electrical energy leading to high operational costs and emission of greenhouse gases. Virtual machine (VM) consolidation has been found to be a promising approach to improve resource utilization and reduce energy consumption of the data center. However, aggressive consolidation of VMs tends to increase the number of VM migrations and leads to over-utilization of hosts. This in turn affects the quality of service (QoS) of the applications running in the VMs. Thus, reduction in energy consumption and at the same time ensuring proper QoS to the Cloud users are one of the major challenges among the researchers. In this paper, we have proposed an energy efficient and QoS-aware VM consolidation technique in order to address this problem. We have used Markov chain-based prediction approach to identify the over-utilized and under-utilized hosts in the data center. We have also proposed an efficient VM selection and placement policy based on linear weighted sum approach to migrate the VMs from over-utilized and under-utilized hosts considering both energy and QoS. Extensive simulations using real-world traces and comparison with state-of-art strategies show that our VM consolidation approach substantially reduces energy consumption within a data center while delivering suitable QoS.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Buyya R, Vecchiola C, Selvi ST (2013) Mastering cloud computing: foundations and applications programming. Newnes

  2. Global warming: Data centres to consume three times as much energy in next decade, experts warn (2016) . https://www.independent.co.uk/environment/global-warming-data-centres-to-consume-three-times-as-much-energy-in-next-decade-experts-warn-a6830086.html. Accessed 13 April 2019

  3. How to stop data centres from gobbling up the world’s electricity (2018). https://www.nature.com/articles/d41586-018-06610-y. Accessed 13 April 2019

  4. Zakarya M, Gillam L (2019) Managing energy, performance and cost in large scale heterogeneous datacenters using migrations. Future Gener Comput Syst 93:529–547

    Article  Google Scholar 

  5. Dayarathna M, Wen Y, Fan R (2016) Data center energy consumption modeling: a survey. IEEE Commun Surv Tutor 18(1):732–794

    Article  Google Scholar 

  6. Barroso LA, Hölzle U (2007) The case for energy-proportional computing. Computer 12:33–37

    Article  Google Scholar 

  7. Fan X, Weber WD, Barroso LA (2007) Power provisioning for a warehouse-sized computer. ACM SIGARCH Comput Archit News ACM 35:13–23

    Article  Google Scholar 

  8. Beloglazov A, Abawajy J, Buyya R (2012) Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener Comput Syst 28(5):755–768

    Article  Google Scholar 

  9. Boutaba R, Zhang Q, Zhani MF (2014) Virtual machine migration in cloud computing environments: benefits, challenges, and approaches. In: Communication infrastructures for cloud computing. IGI Global, pp 383–408

  10. Ding Y, Qin X, Liu L, Wang T (2015) Energy efficient scheduling of virtual machines in cloud with deadline constraint. Future Gener Comput Syst 50:62–74

    Article  Google Scholar 

  11. Li B, Li J, Huai J, Wo T, Li Q, Zhong L (2009) EnaCloud: An energy-saving application live placement approach for cloud computing environments. In: 2009 IEEE International Conference on Cloud Computing. IEEE, pp 17–24

  12. Speitkamp B, Bichler M (2010) A mathematical programming approach for server consolidation problems in virtualized data centers. IEEE Trans Serv Comput 3(4):266–278

    Article  Google Scholar 

  13. Wang S, Zhou A, Hsu CH, Xiao X, Yang F (2016) Provision of data-intensive services through energy-and QoS-aware virtual machine placement in national cloud data centers. IEEE Trans Emerg Top Comput 4(2):290–300

    Article  Google Scholar 

  14. Ghribi C, Hadji M, Zeghlache D (2013) Energy efficient VM scheduling for cloud data centers: exact allocation and migration algorithms. In: 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing. IEEE, pp 671–678

  15. Calheiros RN, Ranjan R, Beloglazov A, De Rose CA, Buyya R (2011) CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50

    Article  Google Scholar 

  16. Beloglazov A, Buyya R (2012) Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers. Concurr Comput Pract Exp 24(13):1397–1420

    Article  Google Scholar 

  17. Piraghaj SF, Dastjerdi AV, Calheiros RN, Buyya R (2015) A framework and algorithm for energy efficient container consolidation in cloud data centers. In: 2015 IEEE International Conference on Data Science and Data Intensive Systems. IEEE, pp 368–375

  18. Shuja J, Madani SA, Bilal K, Hayat K, Khan SU, Sarwar S (2012) Energy-efficient data centers. Computing 94(12):973–994

    Article  Google Scholar 

  19. How data center free cooling works (2015). https://www.masterdc.com/blog/what-is-data-center-free-cooling-how-does-it-work/. Accessed 05 Feb 2020

  20. How data center cooling is changing (2018). https://www.colocationamerica.com/blog/cooling-innovations-for-data-centers. Accessed 05 Feb 2020

  21. Zheng K, Wang X, Li L, Wang X (2014) Joint power optimization of data center network and servers with correlation analysis. In: IEEE INFOCOM 2014-IEEE Conference on Computer Communications. IEEE, pp 2598–2606

  22. Verma A, Ahuja P, Neogi A (2008) pMapper: power and migration cost aware application placement in virtualized systems. In: Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware. Springer, New York, pp 243–264

  23. Murtazaev A, Oh S (2011) Sercon: server consolidation algorithm using live migration of virtual machines for green computing. IETE Tech Rev 28(3):212–231

    Article  Google Scholar 

  24. Tarafdar A, Khatua S, Das RK (2018) QoS aware energy efficient VM consolidation techniques for a virtualized data center. In: 2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC). IEEE, pp 114–123

  25. Gao Y, Guan H, Qi Z, Wang B, Liu L (2013) Quality of service aware power management for virtualized data centers. J Syst Archit 59(4–5):245–259

    Article  Google Scholar 

  26. Farahnakian F, Ashraf A, Pahikkala T, Liljeberg P, Plosila J, Porres I, Tenhunen H (2015) Using ant colony system to consolidate vms for green cloud computing. IEEE Trans Serv Comput 8(2):187–198

    Article  Google Scholar 

  27. Zhang X, Wu T, Chen M, Wei T, Zhou J, Hu S, Buyya R (2019) Energy-aware virtual machine allocation for cloud with resource reservation. J Syst Softw 147:147–161

    Article  Google Scholar 

  28. Wu Q, Ishikawa F, Zhu Q, Xia Y (2016) Energy and migration cost-aware dynamic virtual machine consolidation in heterogeneous cloud datacenters. IEEE Trans Serv Comput 12(4):550–563

    Article  Google Scholar 

  29. Laili Y, Tao F, Wang F, Zhang L, Lin T (2018) An iterative budget algorithm for dynamic virtual machine consolidation under cloud computing environment. IEEE Trans Serv Comput. https://doi.org/10.1109/TSC.2018.2793209

    Article  Google Scholar 

  30. Chaisiri S, Lee BS, Niyato D (2011) Optimization of resource provisioning cost in cloud computing. IEEE Trans Serv Comput 5(2):164–177

    Article  Google Scholar 

  31. Alnowiser A, Aldhahri E, Alahmadi A, Zhu MM (2014) Enhanced weighted round robin (EWRR) with dvfs technology in cloud energy-aware. In: 2014 International conference on computational science and computational intelligence, vol 1. IEEE, pp 320–326

  32. Arroba P, Moya JM, Ayala JL, Buyya R (2015) DVFS-aware consolidation for energy-efficient clouds. In: 2015 international conference on parallel architecture and compilation (PACT). IEEE, pp 494–495

  33. Tang M, Pan S (2015) A hybrid genetic algorithm for the energy-efficient virtual machine placement problem in data centers. Neural Process Lett 41(2):211–221

    Article  Google Scholar 

  34. Zhang X, Lu JJ, Qin X, Zhao XN (2013) A high-level energy consumption model for heterogeneous data centers. Simul Model Pract Theory 39:41–55

    Article  Google Scholar 

  35. Galloway JM, Smith KL, Vrbsky SS (2011) Power aware load balancing for cloud computing. Proc World Congr Eng Comput Sci 1:19–21

    Google Scholar 

  36. Markov chains and prediction (2008). http://www.bandgap.cs.rice.edu/classes/comp140/f08/Module%206/Markovchainsandprediction.pdf. Accessed 16 April 2019

  37. Chapter 11: Markov chains (2016). https://www.dartmouth.edu/~chance/teaching_aids/books_articles/probability_book/Chapter11.pdf. Accessed 16 April 2019

  38. Beloglazov A, Buyya R (2013) Managing overloaded hosts for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints. IEEE Trans Parallel Distrib Syst 24(7):1366–1379

    Article  Google Scholar 

  39. Jung G, Hiltunen MA, Joshi KR, Schlichting RD, Pu C (2010) Mistral: dynamically managing power, performance, and adaptation cost in cloud infrastructures. In: 2010 IEEE 30th International Conference on Distributed Computing Systems. IEEE, pp 62–73

  40. The SPECpower Benchmark (2011) . https://www.spec.org/power_ssj2008/. Accessed 03 May 2019

  41. SPECpower\_ssj2008 Results (2011). https://www.spec.org/power_ssj2008/results/res2011q1/. Accessed 03 May 2019

  42. Amazon EC2 instance types (2018). https://aws.amazon.com/ec2/instance-types/. Accessed 30 June 2018

  43. Moghaddam SM, Piraghaj SF, O’Sullivan M, Walker C, Unsworth C (2018) Energy-efficient and SLA-aware virtual machine selection algorithm for dynamic resource allocation in cloud data centers. In: 2018 IEEE/ACM 11th International Conference on Utility and Cloud Computing (UCC). IEEE, pp 103–113

  44. The openstack cloud computing platform (2019). https://www.openstack.org/. Accessed 09 May 2019

Download references

Acknowledgements

This research is supported by the UGC-NET Junior Research Fellowship (UGC-Ref. No.: 3610/(NET-NOV 2017)) provided by the University Grants Commission, Government of India and Visvesvaraya PhD Scheme of Ministry of Electronics & Information Technology, Government of India, being implemented by the Digital India Corporation (Ref. No. MLA/MUM/GA/10(37)C).

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, University of Calcutta, Kolkata, India

    Anurina Tarafdar, Mukta Debnath, Sunirmal Khatua & Rajib K. Das

Authors
  1. Anurina Tarafdar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mukta Debnath
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sunirmal Khatua
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rajib K. Das
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sunirmal Khatua.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tarafdar, A., Debnath, M., Khatua, S. et al. Energy and quality of service-aware virtual machine consolidation in a cloud data center. J Supercomput 76, 9095–9126 (2020). https://doi.org/10.1007/s11227-020-03203-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-020-03203-3

Keywords

Search

Navigation