Skip to main content
SpringerLink
Log in

Enhanced time-aware QoS prediction in multi-cloud: a hybrid k-medoids and lazy learning approach (QoPC)

  • Published:
Computing Aims and scope Submit manuscript

Abstract

Cloud service providers should be able to predict the future states of their infrastructure in order to avoid any violation of Service Level Agreement. This becomes more complex when vendors have to deal with services from various providers in multi-clouds. As a result, QoS prediction can significantly support service providers in a better understanding of their resources future states. Users should also be very well aware of their resource needs, as well as the Quality of Service relative values. This paper proposes a hybrid approach to the prediction of the future value of the QoS features. The hybrid approach uses a modified version of k-medoids algorithm for the clustering of large time-series datasets, as well as a proposed algorithm inspired from the lazy learning and lower bound Dynamic Time Warping (LB-Keogh) for pruned DTW computations. The proposed method in this manuscript is a shape-based QoS prediction with a novel pre-processing method, which fulfills the missing data with statistically semi-real data. In order to solve the cold start problem, we proposed new algorithm based on the DTW Barycenter Averaging (DBA) algorithm. The results showed that our predicted values are very close to real values and achieve only 0.35 of the normalized mean absolute error rate, on average, for the WSDream dataset and 0.07 for the Alibaba dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Alibaba trace (2017). https://github.com/alibaba/clusterdata. Accessed 28 March 2019

  2. Aghabozorgi S, Shirkhorshidi AS, Wah TY (2015) Time-series clustering-A decade review. Inf Syst 53:16–38

    Article  Google Scholar 

  3. Amin A, Colman A, Grunske L (2012a) An approach to forecasting QoS attributes of web services based on ARIMA and GARCH models. In: 2012 IEEE 19th international conference on web services (ICWS). IEEE, pp 74–81

  4. Amin A, Grunske L, Colman A (2012b) An automated approach to forecasting QoS attributes based on linear and non-linear time series modeling. In: 2012 Proceedings of the 27th IEEE/ACM international conference on automated software engineering (ASE). IEEE, pp 130–139

  5. Benesty J, Chen J, Huang Y, Cohen I (2009) Pearson correlation coefficient. In: Noise reduction in speech processing. Springer, pp 1–4

  6. Beveridge S (1992) Least squates estimation of missing values in time series. Commun Stat Theory Methods 21(12):3479–3496

    Article  MathSciNet  Google Scholar 

  7. Birattari M, Bontempi G, Bersini H (1999) Lazy learning meets the recursive least squares algorithm. Adv Neural Inf Process Syst 375–381

  8. Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowl Based Syst 46:109–132

    Article  Google Scholar 

  9. Bontempi G (1999) Local learning techniques for modeling, prediction and control. Ph.D. thesis, Universite’ Libre de Bruxelles, Belgium

  10. Bontempi G, Taieb SB, Le Borgne YA (2013) Machine learning strategies for time series forecasting. In: Business intelligence. Springer, pp 62–77

  11. Box GE, Jenkins GM, Reinsel GC, Ljung GM (2015) Time series analysis: forecasting and control. Wiley, Hoboken

    MATH  Google Scholar 

  12. Breese JS, Heckerman D, Kadie C (1998) Empirical analysis of predictive algorithms for collaborative filtering. In: Proceedings of the fourteenth conference on uncertainty in artificial intelligence. Morgan Kaufmann Publishers Inc., pp 43–52

  13. Celant G, Broniatowski M (2017) Interpolation and extrapolation optimal designs 2: finite dimensional general models. Wiley, Chichester

    Book  Google Scholar 

  14. Delimitrou C, Kozyrakis C (2013) Paragon: Qos-aware scheduling for heterogeneous datacenters. ACM SIGPLAN Notices, ACM 48:77–88

    Article  Google Scholar 

  15. Delimitrou C, Kozyrakis C (2014) Quasar: resource-efficient and qos-aware cluster management. ACM SIGARCH Computer Architecture News, ACM 42:127–144

    Article  Google Scholar 

  16. Ding S, Li Y, Wu D, Zhang Y, Yang S (2018) Time-aware cloud service recommendation using similarity-enhanced collaborative filtering and ARIMA model. Decis Support Syst 107:103–115

    Article  Google Scholar 

  17. Fulcher BD (2018) Feature-based time-series analysis. In: Feature engineering for machine learning and data analytics. CRC Press, pp 87–116

  18. Garg SK, Versteeg S, Buyya R (2013) A framework for ranking of cloud computing services. Future Gener Comput Syst 29(4):1012–1023

    Article  Google Scholar 

  19. Goldberg K, Roeder T, Gupta D, Perkins C (2001) Eigentaste: a constant time collaborative filtering algorithm. Inf Retr 4(2):133–151

    Article  Google Scholar 

  20. Jain LC, Kacprzyk J (2013) New learning paradigms in soft computing, vol 84. Physica

  21. Kaufman L, Rousseeuw PJ (2009) Finding groups in data: an introduction to cluster analysis. Wiley, Hoboken

    MATH  Google Scholar 

  22. Keogh E, Lin J (2005) Clustering of time-series subsequences is meaningless: implications for previous and future research. Knowl Inf Syst 8(2):154–177

    Article  Google Scholar 

  23. Keogh E, Ratanamahatana CA (2005) Exact indexing of dynamic time warping. Knowl Inf Syst 7(3):358–386

    Article  Google Scholar 

  24. Keshavarzi A, Haghighat AT, Bohlouli M (2017) Adaptive resource management and provisioning in the cloud computing: a survey of definitions, standards and research roadmaps. KSII Trans Internet Inf Syst 11(9)

  25. Kim SW, Park S, Chu WW (2001) An index-based approach for similarity search supporting time warping in large sequence databases. In: Proceedings 17th international conference on data engineering. IEEE, pp 607–614

  26. Menascé DA (2002) QoS issues in web services. IEEE Internet Comput 6(6):72–75

    Article  Google Scholar 

  27. Park HS, Jun CH (2009) A simple and fast algorithm for k-medoids clustering. Expert Syst Appl 36(2):3336–3341

    Article  Google Scholar 

  28. Petitjean F, Ketterlin A, Gançarski P (2011) A global averaging method for dynamic time warping, with applications to clustering. Pattern Recognit 44(3):678–693

    Article  Google Scholar 

  29. Roelofsen P (2018) Time series clustering. Master’s Essay Vrije Universiteit, Amsterdam

    Google Scholar 

  30. Shao L, Zhang J, Wei Y, Zhao J, Xie B, Mei H (2007) Personalized qos prediction forweb services via collaborative filtering. In: IEEE international conference on web services, 2007. ICWS 2007. IEEE, pp 439–446

  31. Shen Z, Subbiah S, Gu X, Wilkes J (2011) Cloudscale: elastic resource scaling for multi-tenant cloud systems. In: Proceedings of the 2nd ACM symposium on cloud computing. ACM, p 5

  32. Song Y, Hu L, Yu M (2018) A novel qos-aware prediction approach for dynamic web services. PLoS ONE 13(8):e0202669

    Article  Google Scholar 

  33. Wang X, Zhu J, Zheng Z, Song W, Shen Y, Lyu MR (2016) A spatial-temporal QoS prediction approach for time-aware Web service recommendation. ACM Trans Web (TWEB) 10(1):7

    Google Scholar 

  34. Wang S, Wang S, Yuan H, Li Q, Geng J, Yu Y (2018) Clustering by differencing potential of data field. Computing 100(4):403–419

    Article  MathSciNet  Google Scholar 

  35. Wei Y, Blake MB (2016) Proactive virtualized resource management for service workflows in the cloud. Computing 98(5):523–538

    Article  MathSciNet  Google Scholar 

  36. Wood T, Cherkasova L, Ozonat K, Shenoy P (2008) Profiling and modeling resource usage of virtualized applications. In: Proceedings of the 9th ACM/IFIP/USENIX international conference on middleware. Springer-Verlag New York, Inc., pp 366–387

  37. Yi BK, Jagadish H, Faloutsos C (1998) Efficient retrieval of similar time sequences under time warping. In: Proceedings 14th international conference on data engineering. IEEE, pp 201–208

  38. Yu C, Huang L (2016) A Web service QoS prediction approach based on time-and location-aware collaborative filtering. SOCA 10(2):135–149

    Article  MathSciNet  Google Scholar 

  39. Zhang Y, Lyu MR (2017) qos prediction in cloud and service computing: approaches and applications. Springer

  40. Zheng Z, Ma H, Lyu MR, King I (2009) Wsrec: a collaborative filtering based web service recommender system. In: IEEE international conference on web services, 2009. ICWS 2009. IEEE, pp 437–444

  41. Zheng Z, Ma H, Lyu MR, King I (2011) Qos-aware web service recommendation by collaborative filtering. IEEE Trans Serv Comput 4(2):140–152

    Article  Google Scholar 

  42. Zheng Z, Zhang Y, Lyu MR (2014) Investigating QoS of real-world web services. IEEE Trans Serv Comput 7(1):32–39

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer and Information Technology Engineering, Qazvin Branch, Islamic Azad University, Qazvin, Iran

    Amin Keshavarzi & Abolfazl Toroghi Haghighat

  2. Research Center for Basic Sciences and Modern Technologies (RBST), Institute for Advanced Studies in Basic Sciences, Zanjan, Iran

    Mahdi Bohlouli

  3. Research and Innovation Department, Petanux GmbH, Bonn, Germany

    Mahdi Bohlouli

  4. Department of Computer Science and Information Technology, Institute for Advanced Studies in Basic Sciences, Zanjan, Iran

    Mahdi Bohlouli

Authors
  1. Amin Keshavarzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abolfazl Toroghi Haghighat
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mahdi Bohlouli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abolfazl Toroghi Haghighat.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Keshavarzi, A., Toroghi Haghighat, A. & Bohlouli, M. Enhanced time-aware QoS prediction in multi-cloud: a hybrid k-medoids and lazy learning approach (QoPC). Computing 102, 923–949 (2020). https://doi.org/10.1007/s00607-019-00747-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-019-00747-y

Keywords

Mathematics Subject Classification

Search

Navigation