Skip to main content
SpringerLink
Log in

Scheduling method with adaptive learning for microservice workflows with hybrid resource provisioning

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

More and more attention has been paid to microservices from traditional monolithic workflows. How to rent on-demand and spot instances for microservice tasks in cloud computing is crucial to save rental costs for customers. According to the out-of-bid failure risks of spot instances and application deadline constraints, it is challenging to adaptively determine the number of on-demand and spot instances, allocate microservice tasks to the rented instances, and reschedule interrupted tasks. In this paper, we consider the problem of scheduling microservice workflows with hybrid resource provisioning. An adaptive-learning based scheduling algorithmic framework is proposed to intelligently sequence, allocate and online adjust tasks as well as monitor spot instance. Strategies for each component are developed. Components and parameter values are statistically calibrated over a comprehensive set of random instances. The proposed algorithm is compared to modified classical algorithms for similar problems. Experimental results demonstrate the effectiveness of the proposal for the considered problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. https://aws.amazon.com/ec2.

  2. https://aws.amazon.com/ecs.

References

  1. Wang S, Li X, Ruiz R (2019) Performance analysis for heterogeneous cloud servers using queueing theory. IEEE Trans Comput 69(4):563–576

    Article  MathSciNet  Google Scholar 

  2. Bernstein D (2015) Containers and cloud: from lxc to docker to kubernetes. IEEE Cloud Comput 1(3):81–84

    Article  Google Scholar 

  3. Wang S, Li X, Ruiz R, Wang Y (2019) Cost minimization for service providers with impatient consumers in cloud computing. In: 2019 IEEE 23rd international conference on computer supported cooperative work in design (CSCWD). IEEE, pp 374–379

  4. Ben-Yehuda O, Ben-Yehuda M, Schuster A, Tsafrir D (2013) Deconstructing amazon ec2 spot instance pricing. ACM Trans Econ Comput 1(3):16

    Google Scholar 

  5. Ostermann S, Prodan R (2012) Impact of variable priced cloud resources on scientific workflow scheduling. In: European conference on parallel processing. Springer, pp 350–362

  6. Topcuoglu H, Hariri S, Min-you W (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260–274

    Article  Google Scholar 

  7. Byun E-K, Kee Y-S, Kim J-S, Deelman E, Maeng S (2011) Bts: resource capacity estimate for time-targeted science workflows. J Parallel Distrib Comput 71(6):848–862

    Article  Google Scholar 

  8. Jia Y, Buyya R (2006) Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci Program 14(3–4):217–230

    Google Scholar 

  9. Yu J, Buyya R, Tham CK (2005) Cost-based scheduling of scientific workflow applications on utility grids. In: First international conference on e-science and grid computing (e-science’05). IEEE, 8 pp

  10. Abrishami S, Naghibzadeh M, Epema D (2012) Cost-driven scheduling of grid workflows using partial critical paths. IEEE Trans Parallel Distrib Syst 23(8):1400–1414

    Article  Google Scholar 

  11. Abrishami S, Naghibzadeh M, Epema DH (2013) Deadline-constrained workflow scheduling algorithms for infrastructure; as a service clouds. Future Gener Comput Syst 29(1):158–169

    Article  Google Scholar 

  12. Cai Z, Li X, Gupta JND (2013) Critical path-based iterative heuristic for workflow scheduling in utility and cloud computing. In: International conference on service-oriented computing

  13. Wu Q, Ishikawa F, Zhu Q, Xia Y, Wen J (2017) Deadline-constrained cost optimization approaches for workflow scheduling in clouds. IEEE Trans Parallel Distrib Syst 28(2):3401–3412

    Article  Google Scholar 

  14. Rodriguez MA, Buyya R (2014) Deadline based resource provisioning and scheduling algorithm for scientific workflows on clouds. IEEE Trans Cloud Comput 2(2):222–235

    Article  Google Scholar 

  15. Bob Familiar (2015) Microservice architecture. Microservices, IoT, and Azure, pp 21–31

  16. Guo D, Wang W, Zeng G, Wei Z (2016) Microservices architecture based cloudware deployment platform for service computing. In: 2016 IEEE symposium on service-oriented system engineering (SOSE). IEEE, pp 358–363

  17. Sill A (2016) The design and architecture of microservices. IEEE Cloud Comput 3(5):76–80

    Article  Google Scholar 

  18. Hasselbring W, Steinacker G (2017) Microservice architectures for scalability, agility and reliability in e-commerce. pp 243–246

  19. Alshuqayran N, Ali N, Evans R (2016) A systematic mapping study in microservice architecture. In: IEEE international conference on service-oriented computing & applications

  20. Villamizar M, Garcés O, Castro H, Verano M, Salamanca L, Casallas R, Gil S (2015) Evaluating the monolithic and the microservice architecture pattern to deploy web applications in the cloud. In: 2015 10th computing colombian conference (10CCC). IEEE, pp 583–590

  21. Ye T, Wang X, Xu X, Chen Y (2017) Dynamic resource allocation algorithm for container-based service computing. In: IEEE international symposium on autonomous decentralized system

  22. Guan X, Wan X, Choi BY, Song S, Zhu J (2017) Application oriented dynamic resource allocation for data centers using docker containers. IEEE Commun Lett 21(3):504–507

    Article  Google Scholar 

  23. Guerrero C, Lera I, Juiz C (2017) Genetic algorithm for multi-objective optimization of container allocation in cloud architecture. J Grid Comput 16(7):113–135

    Google Scholar 

  24. Kai L, Aida K, Yokoyama S, Masatani Y (2016) Flexible container-based computing platform on cloud for scientific workflows. International conference on cloud computing research & innovations

  25. Javadi B, Thulasiram RK, Buyya R (2012) Statistical modeling of spot instance prices in public cloud environments. In: Fourth IEEE international conference on utility & cloud computing

  26. Yi S (2010) Reducing costs of spot instances via checkpointing in the amazon elastic compute cloud. In: IEEE international conference on cloud computing

  27. Plankensteiner K, Prodan R (2012) Meeting soft deadlines in scientific workflows using resubmission impact. IEEE Trans Parallel Distrib Syst 23(5):890–901

    Article  Google Scholar 

  28. Yao G, Ding Y, Hao K (2017) Using imbalance characteristic for fault-tolerant workflow scheduling in cloud systems. IEEE Trans Parallel Distrib Syst 28(2):3671–3683

    Article  Google Scholar 

  29. Poola D, Ramamohanarao K, Buyya R (2016) Enhancing reliability of workflow execution using task replication and spot instances. ACM Trans Auton Adapt Syst (TAAS) 10(4):30

    Google Scholar 

  30. Calheiros RN, Ranjan R, Beloglazov A, César AF (2011) De Rose, and Rajkumar Buyya. Cloudsim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw Pract Exp 41(1):23–50

    Article  Google Scholar 

  31. Fotuhi PS, Vahid DA, Calheiros Rodrigo N, Rajkumar B (2016) Containercloudsim: an environment for modeling and simulation of containers in cloud data centers. Softw Pract Exp 47:505–521

    Google Scholar 

Download references

Acknowledgements

This work is supported by the National Key Research and Development Program of China (No. 2018YFB1402500), the National Natural Science Foundation of China (Nos. 61872077, 61832004) and Collaborative Innovation Center of Wireless Communications Technology.

Author information

Authors and Affiliations

  1. School of Computer and Software, Nanjing Vocational College of Information Technology, Nanjing, 210023, China

    Haihua Gu

  2. School of Computer Science and Engineering, Key Laboratory of Computer Network and Information Integration, Ministry of Education, Southeast University, Nanjing, 211189, China

    Xiaoping Li, Muyao Liu & Shuang Wang

Authors
  1. Haihua Gu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoping Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muyao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shuang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaoping Li.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gu, H., Li, X., Liu, M. et al. Scheduling method with adaptive learning for microservice workflows with hybrid resource provisioning. Int. J. Mach. Learn. & Cyber. 12, 3037–3048 (2021). https://doi.org/10.1007/s13042-021-01396-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-021-01396-4

Keywords

Search

Navigation