Abstract
For different network traffic and network state’s time-varying characteristics, this paper studies the highly energy-efficient network selection algorithm under dynamic change. Network selection algorithm has an important impact on network performance and users’ experience, while current network selection schemes depend on a prior. They cannot effectively select the appropriate network. Targeting users’ quality of experience (QoE) and networks’ energy consumption, this paper uses online dynamic learning property of Q-learning method, consider users’ QoE, networks’ energy consumption, and switch times together, and proposes a QoE based dynamic network selection algorithm. This algorithm can dynamically select the network, obtain the maximum users’ QoE and optimize networks’ energy consumption and switch times. Simulation results show that the proposed algorithm exhibits better performance.
Similar content being viewed by others
References
Wang, L., & Kuo, G. (2012). Mathematical modeling for network selection in heterogeneous wireless networks—A tutorial. IEEE Communications Surveys and Tutorials, 15(1), 271–292.
Kovacs, I., Laselva, D., & Michaelsen, P., et al. (2014). Performance of SON for RSRP-based LTE/WLAN access network selection. In Proceedings of ISWCS’14 (pp. 360–364).
Andreev, S., Gerasimenko, M., Galinina, O., et al. (2014). Intelligent access network selection in converged multi-radio heterogeneous networks. IEEE Wireless Communications, 21(6), 86–96.
Xie, X., Xiao, B., Ma, B., et al. (2017). Cost function weight-variable and speed-adaptive vertical handoff algorithm for a vehicle terminal in heterogeneous wireless networks. Acta Electronica Sinica, 39(10), 2417–2421. (China).
Sun, L., Wei, J., Guo, J., et al. (2014). Node scheduling algorithm for heterogeneous wireless sensor networks. Acta Electronica Sinica, 42(10), 1907–1912. (China).
Brooks, P., & Hestnes, B. (2010). User measures of quality of experience: Why being objective and quantitative Is important. IEEE Network, 24(2), 8–13.
Garcia, V., Zhou, Y., & Shi, J. (2014). Coordinated multipoint transmission in dense cellular networks with user-centric adaptive clustering. IEEE Transactions on Wireless Communications, 13(8), 4297–4308.
Du, B., Li, H., & Long, Y. (2015). Network selection algorithm in heterogeneous wireless networks to minimize the maximum residual service time. Journal on Communications, 36(8), 104–109.
Jiang, D., Xu, Z., Nie, L., et al. (2012). An approximate approach to end-to-end traffic in communication networks. Chinese Journal of Electronics, 21(4), 705–710.
Trestian, R., Ormond, O., & Muntean, G. (2014). Enhanced power-friendly access network selection strategy for multimedia delivery over heterogeneous wireless networks. IEEE Transactions on Broadcasting, 60(1), 85–101.
Tang, L., Li, W., Sheng, J., et al. (2019). A chaos genetic algorithm based access selection in heterogeneous wireless networks. Acta Electronica Sinica, 42(8), 1564–1570.
Haldar, K., Ghosh, C., & Agrawal, D. (2013). Dynamic spectrum access and network selection in heterogeneous cognitive wireless networks. Pervasive and Mobile Computing, 9(4), 484–497.
Wang, H., Laurenson, D., & Hillston, J. (2013). A general performance evaluation framework for network selection strategies in 3G-WLAN interworking networks. IEEE Transactions on Mobile Computing, 12(5), 868–884.
Jiang, D., Wang, X., Guo, L., et al. (2019). Approach of traffic matrix estimation in large-scale IP backbone networks. Acta Eletronica Sinica, 39(4), 763–771.
Liu, Y., Chen, Z., Laurence, T., et al. (2014). User preference heterogeneous network selection in less subjective ways. Wireless Personal Communications, 76(4), 813–828.
Verma, R., & Singh, N. (2013). GRA based network selection in heterogeneous wireless networks. Wireless Personal Communications, 72(2), 1437–1452.
Xu, K., Wang, K., Amin, R., et al. (2015). A fast cloud-based network selection scheme using coalition formation games in vehicular networks. IEEE Transactions on Vehicular Technology, 64(11), 5327–5339.
Pan, S., Zhou, W., Gu, Q., et al. (2017). Network selection algorithm based on spectral bandwidth mapping and an economic model in WLAN & LTE heterogeneous networks. KSII Transactions on Internet and Information Systems, 9(1), 68–86.
Jiang, D., Xu, Z., & Xu, H. (2017). A novel hybrid prediction algorithm to network traffic. Annals of Telecommunications, 70(9), 427–439.
Cheung, M., & Huang, J. (2015). DAWN: Delay-aware Wi-Fi offloading and network selection. IEEE Journal on Selected Areas in Communications, 33(6), 1214–1223.
Wang, Y., Yu, J., & Lin, X., et al. (2015). A uniform framework for network selection in cognitive radio networks. In: Proceedings of the IEEE international conference on communications (pp. 3708–3713).
Jiang, J., Li, J., Hou, R., et al. (2017). Network selection policy based on effective capacity in heterogeneous wireless communication systems. Science China Information Sciences, 57(2), 1–7.
Hanay, Y., Arakawa, S., Murata, M., et al. (2017). Network topology selection with multistate neural memories. Expert Systems with Applications, 42(6), 3219–3226.
Jiang, D., Wang, Y., Yao, C., et al. (2015). An effective dynamic spectrum access algorithm for multi-hop cognitive wireless networks. Computer Networks, 84(19), 1–16.
Du, Z., Wu, Q., & Yang, P. (2017). Dynamic user demand-driven online network selection. IEEE Communications Letters, 18(3), 419–422.
Deng, S., Sivaraman, A., & Balakrishnan, H. (2014). All your network are belong to us: A transport framework for mobile network selection. In Proceedings of the HotMobile’14 (pp. 1–6).
Kumar, A., Mallik, R., & Schober, R. (2017). A probabilistic approach to modeling users’ network selection in the presence of heterogeneous wireless networks. IEEE Transactions on Vehicular Technology, 63(7), 3331–3341.
Du, Z., Wu, Q., Yang, P., et al. (2018). User-demand-aware wireless network selection: A localized cooperation approach. IEEE Transactions on Vehicular Technology, 63(9), 4492–4507.
Jiang, D., Xu, Z., Wang, W., et al. (2015). A collaborative multi-hop routing algorithm for maximum achievable rate. Journal of Network and Computer Applications, 57(4), 182–191.
Ahuja, K., Singh, B., & Khanna, R. (2014). Network selection algorithm based on link quality parameters for heterogeneous wireless networks. Optik, 125(14), 3657–3662.
Kiumarsi, B., Lewis, F., Modares, H., et al. (2014). Reinforcement Q-learning for optimal tracking control of linear discrete-time systems with unknown dynamics. Automatica, 50(4), 1167–1175.
Prabuchandran, K., Meena, S., & Bhatnagar, S. (2017). Q-learning based energy management policies for a single sensor node with finite buffer. IEEE Wireless Communications Letters, 2(1), 82–85.
Camp, T., Boleng, J., & Davies, V. (2002). A survey of mobility models for Ad Hoc network research. Wireless Communication and Mobile Computing, 2(5), 483–502.
Video Quality Experts Group. (2003). Final report on the validation of objective models of video quality assessment.
ITU-T Recommendation G.107. (1998). The E-model: A computational model for use in transmission planning. December 1998. https://www.itu.int/rec/T-REC-G.107.
Manzoor, A., & Umar, T. (2017). User utility function as quality of experience (QoE). In: Proceedings of the tenth international conference on networks (pp. 99–104).
Jiang, D., Wang, Y., Lv, Z., et al. (2019). Big data analysis-based network behavior insight of cellular networks for industry 4.0 applications. IEEE Transactions on Industrial Informatics. https://doi.org/10.1109/tii.2019.2930226.
Jiang, D., Huo, L., Lv, Z., et al. (2018). A joint multi-criteria utility-based network selection approach for vehicle-to-infrastructure networking. IEEE Transactions on Intelligent Transportation Systems, 19(10), 3305–3319.
Jiang, D., Huo, L., & Song, H. (2018). Rethinking behaviors and activities of base stations in mobile cellular networks based on big data analysis. IEEE Transactions on Network Science and Engineering, 1(1), 1–12.
Jiang, D., Wang, W., Shi, L., et al. (2018). A compressive sensing-based approach to end-to-end network traffic reconstruction. IEEE Transactions on Network Science and Engineering, 5(3), 1–12.
Jiang, D., Huo, L., & Li, Y. (2018). Fine-granularity inference and estimations to network traffic for SDN. PLoS ONE, 13(5), 1–23.
Acknowledgement
This work was supported by National Natural Science Foundation of China (No. 61571104), Sichuan Science and Technology Program (No. 2018JY0539), Key projects of the Sichuan Provincial Education Department (No. 18ZA0219), Fundamental Research Funds for the Central Universities (No. ZYGX2017KYQD170), and Innovation Funding (No. 2018510007000134). The authors wish to thank the reviewers for their helpful comments.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
He, L., Jiang, D. & Wei, C. A QoE-based dynamic energy-efficient network selection algorithm. Wireless Netw 27, 3585–3595 (2021). https://doi.org/10.1007/s11276-019-02231-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11276-019-02231-z