Skip to main content
Log in

Autonomic task scheduling algorithm for dynamic workloads through a load balancing technique for the cloud-computing environment

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Applying the load balancing technique to allocate requests that dynamically enter the cloud environment is contributive in maintaining the system stability, reducing the response time, and increasing the resource productivity. One of the main challenges in dynamic load balancing is that it increases inter-VM communication overheads (swapping files between VMs). In most of the methods proposed for load balancing the issue of communication overheads is overlooked. Attempt is made here to address this problem through the Autonomous Load Balancing method. In the available studies on task scheduling in cloud computing, the focus is mostly on CPU-bound requests. Here, based on the resources, the needed the requests are divided into CPU-bound and I/O-bound requests. Considering both types of requests leads to the inability to apply the available load balancing methods. The CloudSim tool is applied here to evaluate this proposed method, which is then compared with Round Robin, Autonomous, Honey-Bee and Naïve Bayesian Load Balancing approaches. The results for the actual workloads of the NASA and Calgary servers and sample workload indicate that upon an increase in the requests and their variations together with heterogeneity of different VMs, this proposed algorithm can distribute the workload among them equally and allocate requests to appropriate VMs based on the required resources; thus, a decrease in the communication overheads and an increase in load balancing degree.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. Adaptive neuro-fuzzy inference system.

References

  1. Dhinesh Babu, L.D., Venkata Krishna, P.: Honey bee behavior inspired load balancing of tasks in cloud computing environments. Appl. Soft Comput. 13, 2292–2303 (2013)

    Article  Google Scholar 

  2. Zhao, J., Yang, K., Wei, X., Ding, Y., Hu, L., Xu, G.: A heuristic clustering-based task deployment approach for load balancing using Bayes theorem in cloud environment. IEEE Trans. Parallel Distrib. Syst. 27(2), 305–316 (2016)

    Article  Google Scholar 

  3. Ebadifard, F., Babamir, S.M.: A modified black hole-based multi-objective workflow scheduling improved using the priority queues for cloud computing environment. In: 2018 4th International Conference on Web Research (ICWR), pp. 162–167. (2018)

  4. Ebadifard, F., Babamir, S.M.: Optimizing multi objective based workflow scheduling in cloud computing using black hole algorithm. In: 2017 3th International Conference on Web Research (ICWR), pp. 102–108. (2017)

  5. Ebadifard, F., Babamir, S.M.: A multi-objective approach with waspas decision-making for workflow scheduling in cloud environment. Int. J. Web Res. 1(1), 1–10 (2018)

    Google Scholar 

  6. Ebadifard, F., Babamir, S.M.: Scheduling scientific workflows on virtual machines using a Pareto and hypervolume based black hole optimization algorithm. J. Supercomput. (2020). https://doi.org/10.1007/s11227-020-03183-4

    Article  Google Scholar 

  7. Ebadifard, F., Babamir, S.M.: A PSO-based task scheduling algorithm improved using a load-balancing technique for the cloud computing environment. Concurr. Comput.: Pract. Exp. 30(12), e4368 (2018)

    Article  Google Scholar 

  8. Nakai, A., Madeira, E., Buzato, L.E.: On the use of resource reservation for web services load balancing. J. Netw. Syst. Manag. 23(3), 502–538 (2015)

    Article  Google Scholar 

  9. Daraghmi, E.Y., Yuan, S.-M.: A small world based overlay network for improving dynamic load-balancing. J Syst Softw. 107, 187–203 (2015)

    Article  Google Scholar 

  10. Sheikhi, S., Babamir, S.M.: A predictive framework for load balancing clustered web servers. J. Supercomput. 72(2), 588–611 (2016)

    Article  Google Scholar 

  11. Sheikhi, S., Babamir, S.M.: Using a recurrent artificial neural network for dynamic self-adaptation of cluster-based web-server systems. Appl. Intell. 48(8), 2097–2111 (2018)

    Article  Google Scholar 

  12. Mittal, S., Katal, A.: An optimized task scheduling algorithm in cloud computing. In: 2016 IEEE 6th International Conference on Advanced Computing (IACC), 197‐202. (2016)

  13. Kokilavani, T., George Amalarethinam, D.I.: Load balanced min-min algorithm for static meta-task scheduling in grid computing. Int. J. Comput. Appl 20(2), 43–49 (2011)

    Google Scholar 

  14. George Amalarethinam, V.K.: Max-min average algorithm for SchedulingTasks in grid computing systems. Int. J. Comput. Sci. Inform. Technol. 3(2), 3659–3663 (2012)

    Google Scholar 

  15. Polepally, V., Shahu Chatrapati, K.: Dragonfly optimization and constraint measure-based load balancing in cloud computing. Cluster Comput. 22(1), 1099–1111 (2019)

    Article  Google Scholar 

  16. Jyoti, A., Shrimali, M.: Dynamic provisioning of resources based on load balancing and service broker policy in cloud computing. Cluster Comput. 23(1), 377–395 (2020)

    Article  Google Scholar 

  17. Ben Alla, H., Ben Alla, S., Touhafi, A., Ezzati, A.: A novel task scheduling approach based on dynamic queues and hybrid meta-heuristic algorithms for cloud computing environment. Cluster Comput. 21(4), 1797–1820 (2018)

    Article  Google Scholar 

  18. Ghoneem, M., Kulkarni, L.: An adaptive MapReduce scheduler for scalable heterogeneous systems. In: Proceedings of the International Conference on Data Engineering and Communication Technology. Springer, 603–611. (2017). https://doi.org/10.1007/978-981-10-1678-3_57

  19. Chen, S.L., Chen, Y.Y., Kuo, S.H.: CLB: a novel load balancing architecture and algorithm for cloud services. Comput. Electr. Eng. 58(2017), 154–160 (2017). https://doi.org/10.1016/j.compeleceng.2016.01.029

    Article  Google Scholar 

  20. Xin, Y., Xie, Z.Q., Yang, J.: A load balance oriented cost efficient scheduling method for parallel tasks. J. Netw. Comput. Appl. 81(2017), 37–46 (2017)

    Article  Google Scholar 

  21. Kang, B., Choo, H.: A cluster-based decentralized job dispatching for the large-scale cloud. J. Wirel. Commun. Netw. (2016). https://doi.org/10.1186/s13638-016-0523-6

    Article  Google Scholar 

  22. Chunlin, L., Jianhang, T., Youlong, L.: Hybrid cloud adaptive scheduling strategy for heterogeneous workloads. J. Grid Comput. 17(3), 419–446 (2019)

    Article  Google Scholar 

  23. Wang, S., Li, K., Mei, J., Xiao, G., Li, K.: A reliability-aware task scheduling algorithm based on replication on heterogeneous computing systems. J. Grid Comput. 15(1), 23–39 (2017)

    Article  Google Scholar 

  24. Kong, L., Mapetu, J.P.B., Chen, Z.: Heuristic load balancing based zero imbalance mechanism in cloud computing. J. Grid Comput. 18(1), 123–148 (2019)

    Article  Google Scholar 

  25. Ebadifard, F., Babamir. S.M.: Dynamic task scheduling in cloud computing based on Naïve Bayesian classifier. In: Proceedings of the International Conference for Young Researchers in Informatics, Mathematics and Engineering Kaunas, Lithuania, vol. 1852, 28 April 2017

  26. Nikravesh, A.Y., Ajila, S.A., Lung, C.-H.: Towards an autonomic auto-scaling prediction system for cloud resource provisioning, presented at the Proceedings of the 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Florence, Italy, 2015

  27. Ramanathan, R., Latha, B.: Towards optimal resource provisioning for Hadoop-MapReduce jobs using scale-out strategy and its performance analysis in private cloud environment. Cluster Comput. 22(6), 14061–14071 (2019)

    Article  Google Scholar 

  28. Gill, S.S., Chana, I., Singh, M., Buyya, R.: CHOPPER: an intelligent QoS-aware autonomic resource management approach for cloud computing. Cluster Comput. 21(2), 1203–1241 (2018)

    Article  Google Scholar 

  29. Tamilvizhi, T., Parvathavarthini, B.: A novel method for adaptive fault tolerance during load balancing in cloud computing. Cluster Comput. 22(5), 10425–10438 (2019)

    Article  Google Scholar 

  30. Shahidinejad, A., Ghobaei-Arani, M., Masdari, M.: Resource provisioning using workload clustering in cloud computing environment: a hybrid approach. Cluster Comput. (2020). https://doi.org/10.1007/s10586-020-03107-0

    Article  Google Scholar 

  31. Hasan, M.Z., Magana, E., Clemm, A., Tucker, L., Gudreddi, S.L.D.: Integrated and autonomic cloud resource scaling. In: 2012 IEEE Network Operations and Management Symposium, pp. 1327–1334 (2012)

  32. Sedaghat, M., Hernández-Rodríguez, F., Elmroth, E.: Autonomic resource allocation for cloud data centers: a peer to peer approach. In: 2014 International Conference on Cloud and Autonomic Computing, pp. 131–140 (2014)

  33. Singh, P., Kaur, A., Gupta, P., Gill, S.S., Jyoti, K.: RHAS: robust hybrid auto-scaling for web applications in cloud computing. Cluster Comput. (2020). https://doi.org/10.1007/s10586-020-03148-5

    Article  Google Scholar 

  34. Kim, H., El-Khamra, Y., Rodero, I., Jha, S., Parashar, M.: Autonomic management of application workflows on hybrid computing infrastructure. Sci. Prog. 19(2–3), 75–89 (2011)

    Google Scholar 

  35. Bala, A., Chana, I.: Autonomic fault tolerant scheduling approach for scientific workflows in Cloud computing. Concurr. Eng. 23(1), 27–39 (2015)

    Article  Google Scholar 

  36. Bonvin, N., Papaioannou, T.G., Aberer, K.: Autonomic SLA-driven provisioning for Cloud applications, presented at the Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, 2011

  37. Sah, S,K., Joshi, S.R.: Scalability of efficient and dynamic workload distribution in autonomic cloud computing. In: 2014 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT), pp. 12-18. (2014)

  38. Ghobaei-Arani, M., Jabbehdari, S., Pourmina, M.A.: An autonomic resource provisioning approach for service-based cloud applications: a hybrid approach. Future Gener. Comput. Syst. 78, 191–210 (2018)

    Article  Google Scholar 

  39. Fang, Y., Wang, F., Ge, J.: A Task Scheduling Algorithm Based on Load Balancingin Cloud Computing, WISM 2010, LNCS 6318, pp. 271–277, 2010

  40. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments andevaluation of resource provisioning algorithms. Softw. Pract. Exp. 41, 23–50 (2011)

    Article  Google Scholar 

  41. Lin, W., Xu, S., He, L., Li, J.: Multi-resource scheduling and power simulation for cloud computing. Inf. Sci. 397–398, 168–186 (2017)

    Article  Google Scholar 

  42. Zuo, L., Dong, S., Shu, L., Zhu, C., Han, G.: A Multiqueue interlacing peak scheduling method based on tasks’ classification in cloud computing. IEEE Syst. J. 12(2), 1518–1530 (2016)

    Article  Google Scholar 

  43. Liao, W.-H., Chen, P.-W., Kuai, S.-C.: A resource provision strategy for software-as-a-service in cloud computing. Proc. Comput. Sci. 110, 94–101 (2017)

    Article  Google Scholar 

  44. Elrotub, M., Gherbi, A.: Virtual machine classification-based approach to enhanced workload balancing for cloud computing applications. Proc. Comput. Sci. 130, 683–688 (2018)

    Article  Google Scholar 

  45. Li, B., Han, L.: Distance Weighted Cosine Similarity Measure for Text Classification, pp. 611–618. Springer, Berlin (2013)

    Google Scholar 

  46. Jomaa, W.B., Youssef, H., Lohier, S., Pujolle, G.: A cross-layer autonomic architecture for QoS support in wireless networks. In: 2008 1st IFIP Wireless Days, pp. 1–6 (2008)

  47. Jang, J.S.R.: ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans. Syst. Man Cybern. 23(3), 665–685 (1993)

    Article  Google Scholar 

  48. Liu, M., Dong, M., Wu, C.: A new ANFIS for Parameter Prediction With Numeric And Categorical Inputs. IEEE Trans. Autom. Sci. Eng. 7(3), 645–653 (2010)

    Article  Google Scholar 

  49. Özkan, G., İnal, M.: Comparison of neural network application for fuzzy and ANFIS approaches for multi-criteria decision making problems. Appl. Soft Comput. 24, 232–238 (2014)

    Article  Google Scholar 

  50. de Mello, R.F., Senger, L.J., Yang L.T.: A routing load balancing policy for grid computing environments. In: 20th International Conference on Advanced Information Networking and Applications, vol. 1, 18–20 656 April. AINA 2006. 657 (2006)

  51. Feitelson, D.G., Nitzberg, B.: Job characteristics of a production parallel scientific workload on the NASA Ames iPSC/860. In: Job Scheduling Strategies for Parallel Processing, 337–360 (1995)

  52. Arlitt, M.F., Williamson, C.L.: Web server workload characterization: the search for invariants, presented at the Proceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, Philadelphia, Pennsylvania, USA, 1996

  53. Buyya, D.: List of workloads, traces, and models for distributed systems. In: The Cloud Computing and Distributed Systems, CLOUDS, Laboratory, University of Melbourne, 2017, https://www.cloudbus.org/workloads.html. Accessed 9 Aug 2017

  54. Dastghibyfard, Gh., Horri, A.: Cost of time-shared policy in cloud environment. In: Proceedings of the Third International Conference on Contemporary Issues in Computer and Information Sciences (CICIS), 2012

  55. Ebadifard, F., Doostali, S., Babamir, S.M.: A firefly-based task scheduling algorithm for the cloud computing environment: formal verification and simulation analyses. In: 2018 9th International Symposium on Telecommunications (IST), pp. 664–669. (2018)

  56. Ebadifard, F., Babamir, S.M., Barani, S.: A dynamic task scheduling algorithm improved by load balancing in cloud computing. In: 2020 6th International Conference on Web Research (ICWR), pp. 177–183. (2020)

Download references

Funding

This funding was supported by University of Kashan.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Seyed Morteza Babamir.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ebadifard, F., Babamir, S.M. Autonomic task scheduling algorithm for dynamic workloads through a load balancing technique for the cloud-computing environment. Cluster Comput 24, 1075–1101 (2021). https://doi.org/10.1007/s10586-020-03177-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-020-03177-0

Keywords

Navigation