Skip to main content
SpringerLink
Log in

A dynamic task scheduler tolerant to multiple hibernations in cloud environments

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Cloud platforms usually offer several types of Virtual Machines (VMs) with different guarantees in terms of availability and volatility, provisioning the same resource through multiple pricing models. For instance, in the Amazon EC2 cloud, the user pays per use for on-demand VMs while spot VMs are instances available at lower prices. However, a spot VM can be terminated or hibernated by EC2 at any moment. In this work, we propose the Hibernation-Aware Dynamic Scheduler (HADS) that schedules Bag-of-Tasks (BoT) applications with deadline constraints in both hibernation prone spots VMs and on-demand VMs. HADS aims at minimizing the monetary costs of executing BoT applications on Clouds ensuring that their deadlines are respected even in the presence of multiple hibernations. Results collected from experiments on Amazon EC2 VMs using synthetic applications and a NAS benchmark application show the effectiveness of HADS in terms of monetary costs when compared to on-demand VM only solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Ahrens, J.H., Dieter, U.: Computer methods for sampling from gamma, beta, poisson and bionomial distributions. Computing 12(3), 223–246 (1974)

    Article  MathSciNet  Google Scholar 

  2. Alves, M.M., de Assumpção Drummond, L.M.: A multivariate and quantitative model for predicting cross-application interference in virtual environments. J. Syst. Softw. 128, 150–163 (2017). https://doi.org/10.1016/j.jss.2017.04.001

    Article  Google Scholar 

  3. Aupy, G., Benoit, A., Melhem, R.G., Renaud-Goud, P., Robert, Y.: Energy-aware checkpointing of divisible tasks with soft or hard deadlines. In: International Green Computing Conference, IGCC 2013, Arlington, VA, USA, June 27–29, 2013, Proceedings, pp. 1–8 (2013)

  4. AWS, A.: Amazon EC2 Spot Lets you Pause and Resume Your Workloads. https://aws.amazon.com/about-aws/whats-new/2017/11/amazon-ec2-spot-lets-you-pause-and-resume-your-workloads/ (2017). Accessed 15 December 2019

  5. Bailey, D., Harris, T., Saphir, W., Van Der Wijngaart, R., Woo, A., Yarrow, M.: The nas parallel benchmarks 2.0. Tech. rep., Technical Report NAS-95-020, NASA Ames Research Center (1995)

  6. Barr, J.: New-per-second billing for EC2 instances and EBS volumes. https://aws.amazon.com/pt/blogs/aws/new-per-second-billing-for-ec2-instances-and-ebs-volumes/ (2017). Accessed 15 Dec 2019

  7. Chakravarthi, K.K., Shyamala, L., Vaidehi, V.: Budget aware scheduling algorithm for workflow applications in IAAS clouds. Clust. Comput. (2020). https://doi.org/10.1007/s10586-020-03095-1

    Article  Google Scholar 

  8. Chhabra, A., Singh, G., Kahlon, K.S.: Multi-criteria HPC task scheduling on IAAS cloud infrastructures using meta-heuristics. Clust. Comput (2020). https://doi.org/10.1007/s10586-019-02983-5

    Article  Google Scholar 

  9. Dongarra, J.J., Luszczek, P., Petitet, A.: The linpack benchmark: past, present and future. Concurr. Comput. Pract. Exp. 15(9), 803–820 (2003)

    Article  Google Scholar 

  10. Fabra, J., Ezpeleta, J., Álvarez, P.: Reducing the price of resource provisioning using ec2 spot instances with prediction models. Future Gener. Comput. Syst. 96, 348–367 (2019)

    Article  Google Scholar 

  11. Farahabady, M.H., Lee, Y.C., Zomaya, A.Y.: Non-clairvoyant assignment of bag-of-tasks applications across multiple clouds. In: 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies, pp. 423–428. IEEE (2012)

  12. Ghobaei-Arani, M., Souri, A., Safara, F., Norouzi, M.: An efficient task scheduling approach using moth-flame optimization algorithm for cyber-physical system applications in fog computing. Trans. Emerg. Telecommun. Technol. 31(2), e3770 (2020)

    Google Scholar 

  13. Goiri, I., Julià, F., Guitart, J., Torres, J.: Checkpoint-based fault-tolerant infrastructure for virtualized service providers. In: IEEE/IFIP Network Operations and Management Symposium, NOMS 2010, 19–23 April 2010, Osaka, Japan, pp. 455–462 (2010)

  14. Gutierrez-Garcia, J.O., Sim, K.M.: A family of heuristics for agent-based elastic cloud bag-of-tasks concurrent scheduling. Future Gener. Comput. Syst. 29(7), 1682–1699 (2013)

    Article  Google Scholar 

  15. Huang, X., Li, C., Chen, H., An, D.: Task scheduling in cloud computing using particle swarm optimization with time varying inertia weight strategies. Cluster Comput. 23, 1137–1147 (2019)

    Article  Google Scholar 

  16. Katevenis, M., Sidiropoulos, S., Courcoubetis, C.: Weighted round-robin cell multiplexing in a general-purpose atm switch chip. IEEE J. Sel. Areas Commun. 9(8), 1265–1279 (1991)

    Article  Google Scholar 

  17. Keshanchi, B., Souri, A., Navimipour, N.J.: An improved genetic algorithm for task scheduling in the cloud environments using the priority queues: formal verification, simulation, and statistical testing. J. Syst. Softw. 124, 1–21 (2017)

    Article  Google Scholar 

  18. Kumar, D., Baranwal, G., Raza, Z., Vidyarthi, D.P.: A survey on spot pricing in cloud computing. J. Netw. Syst. Manage. 26(4), 809–856 (2018)

    Article  Google Scholar 

  19. Lu, S., Li, X., Wang, L., Kasim, H., Palit, H.N., Hung, T., Legara, E.F.T., Lee, G.K.K.: A dynamic hybrid resource provisioning approach for running large-scale computational applications on cloud spot and on-demand instances. In: 19th IEEE International Conference on Parallel and Distributed Systems, ICPADS 2013, Seoul, Korea, December 15–18, 2013, pp. 657–662 (2013)

  20. Lu, Y., Sun, N.: An effective task scheduling algorithm based on dynamic energy management and efficient resource utilization in green cloud computing environment. Cluster Comput. 22(1), 513–520 (2019)

    Article  MathSciNet  Google Scholar 

  21. Menache, I., Shamir, O., Jain, N.: On-demand, spot, or both: Dynamic resource allocation for executing batch jobs in the cloud. In: 11th International Conference on Autonomic Computing, ICAC ’14, Philadelphia, PA, USA, June 18–20, 2014, pp. 177–187 (2014)

  22. Oprescu, A.M., Kielmann, T.: Bag-of-tasks scheduling under budget constraints. In: 2010 IEEE Second International Conference on Cloud Computing Technology and Science, pp. 351–359. IEEE (2010)

  23. Pary, R.: New Amazon EC2 Spot pricing model: simplified purchasing without bidding and fewer interruptions. https://aws.amazon.com/pt/blogs/compute/new-amazon-ec2-spot-pricing/ (2017). Accessed 15 Dec 2019

  24. Sharma, P., Lee, S., Guo, T., Irwin, D.E., Shenoy, P.J.: Spotcheck: designing a derivative IAAS cloud on the spot market. In: Proceedings of the Tenth European Conference on Computer Systems, EuroSys 2015, Bordeaux, France, April 21–24, 2015, pp. 16:1–16:15 (2015)

  25. Subramanya, S., Guo, T., Sharma, P., Irwin, D.E., Shenoy, P.J.: Spoton: a batch computing service for the spot market. In: Proceedings of the Sixth ACM Symposium on Cloud Computing, SoCC 2015, Kohala Coast, Hawaii, USA, August 27–29, 2015, pp. 329–341 (2015)

  26. Tang, X., Liao, X., Zheng, J., Yang, X.: Energy efficient job scheduling with workload prediction on cloud data center. Cluster Comput. 21(3), 1581–1593 (2018)

    Article  Google Scholar 

  27. Teylo, L., Arantes, L., Sens, P., Drummond, L.M.: A bag-of-tasks scheduler tolerant to temporal failures in clouds. In: 2019 31st International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD), pp. 144–151 (2019)

  28. Teylo, L., Arantes, L., Sens, P., Drummond, L.M.: A hibernation aware dynamic scheduler for cloud environments. In: Proceedings of the 48th International Conference on Parallel Processing: Workshops, p. 24. ACM (2019)

  29. Varshney, P., Simmhan, Y.: Autobot: resilient and cost-effective scheduling of a bag of tasks on spot vms. IEEE Trans. Parallel Distrib. Syst. 30(7), 1512–1527 (2019)

    Article  Google Scholar 

  30. Yao, M., Zhang, P., Li, Y., Hu, J., Li, C., Li, X.: Cutting your cloud computing cost for deadline-constrained batch jobs. In: 2014 IEEE International Conference on Web Services, ICWS, 2014, Anchorage, AK, USA, June 27–July 2, 2014, pp. 337–344 (2014)

  31. Yi, S., Andrzejak, A., Kondo, D.: Monetary cost-aware checkpointing and migration on amazon cloud spot instances. IEEE Trans. Serv. Comput. 5(4), 512–524 (2011)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by FAPERJ (process number E-26 200.752/2019 242697) and Programa Institucional de Internacionalização (PrInt) from CAPES as part of the project REMATCH (process number 88887. 310261/2018-00).

Author information

Authors and Affiliations

  1. Instituto de Computaçāo, Universidade Federal Fluminense, Niterói, Brazil

    Luan Teylo & Lucia M. A. Drummond

  2. Sorbonne Université, CNRS, INRIA, LIP6, Paris, France

    Luciana Arantes & Pierre Sens

Authors
  1. Luan Teylo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luciana Arantes
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pierre Sens
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lucia M. A. Drummond
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luan Teylo.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Teylo, L., Arantes, L., Sens, P. et al. A dynamic task scheduler tolerant to multiple hibernations in cloud environments. Cluster Comput 24, 1051–1073 (2021). https://doi.org/10.1007/s10586-020-03175-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-020-03175-2

Keywords

Search

Navigation