Skip to main content
SpringerLink
Log in

Adaptive relay strategy selection based on Q-learning for power line and wireless dual-media communication with hybrid duplex

  • Original Paper
  • Published:
Wireless Networks Aims and scope Submit manuscript

Abstract

Relay algorithms in power line and wireless dual-media cooperative communication exhibit distinct advantages and disadvantages under random channels, and the algorithm that achieves the best performance can be determined through an adaptive relay strategy. However, the theoretical performance analysis of multiple relay algorithms for mixed fading and impulse noise encounters practical difficulties, such as lack of closed-form expressions and high complexity of the approximation process. This study proposes an adaptive relay strategy selection algorithm based on Q-learning, which can maximize the mutual information in the system. The feedback of the amount of mutual information is obtained by learning the dual-media cooperative communication environment of the time-varying fading channel to determine the optimal relay algorithm and power allocation factor. This study also analyzes the influence of the average signal-to-noise ratio, relay position, and power line channel parameters on the performance of the algorithm in terms of mutual information and outage probability and implements Q-learning-based relay strategy selection. Simulation results show that the proposed algorithm can obtain a quasi-optimal system performance in terms of the above two measures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Dib, L., & d. M. B. A., Fernandes, V., Filomeno, M. de L., & Ribeiro, M. V. . (2018). Hybrid PLC/wireless communication for smart grids and internet of things applications. IEEE Internet of Things Journal, 5(2), 655–667.

    Article  Google Scholar 

  2. Lai, S. W., & Messier, G. G. (2012). Using the wireless and PLC channels for diversity. IEEE Transactions on Communications, 60(12), 3865–3875.

    Article  Google Scholar 

  3. Chen, Z., Han, D., & Qiu, L. (2017). Research on the performance of cooperation communication system based on indoor double media with wireless channel and power line. Proceedings of the CSEE, 37(9), 2589–2598.

    Google Scholar 

  4. Mathur, A., Bhatnagar, M. R., Ai, Y., & Cheffena, M. (2018). Performance analysis of a dual-hop wireless-power line mixed cooperative system. IEEE Access, 6, 34380–34392.

    Article  Google Scholar 

  5. Chen, Z., Jing, Y., Han, D., Qiu, L., & Tian, X. (2018). Power optimization allocation based on moment generation function approximation in dual media cooperative communication. Automation of Electric Power Systems, 42(23), 159–171.

    Article  Google Scholar 

  6. Chen, Z., Wang, L., Han, D., & Zeng, H. (2020). A unified performance analysis of relaying communication system for IoT application with hybrid fading. IEEE Internet of Things Journal, 7(1), 570–583.

    Article  Google Scholar 

  7. Sun, Y., Chen, Z., Tao, M., & Liu, H. (2020). Bandwidth gain from mobile edge computing and caching in wireless multicast systems. IEEE Transactions on Wireless Communications, 19(6), 3992–4007.

    Article  Google Scholar 

  8. Zhang, Z., Chai, X., Long, K., Vasilakos, A. V., & Hanzo, L. (2015). Full duplex techniques for 5G networks: Self-interference cancellation, protocol design, and relay selection. IEEE Communications Magazine, 53(5), 128–137.

    Article  Google Scholar 

  9. Prasad, G., & Lampe, L. (2020). Full-duplex power line communications: Design and applications from multimedia to smart grid. IEEE Communications Magazine, 58(2), 106–112.

    Article  Google Scholar 

  10. Rabie, K. M., Adebisi, B., & Alouini, M. (2017). Half-duplex and full-duplex AF and DF relaying with energy-harvesting in Log-normal fading. IEEE Transactions on Green Communications and Networking, 1(4), 468–480.

    Article  Google Scholar 

  11. Miao, Q., Bai, B., & Chen, W. (2017). Adaptive AF/DF selection with FD/HD switching in two-way relay networks. IEEE Access, 5, 11594–11605.

    Article  Google Scholar 

  12. Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019). Application of machine learning in wireless networks: Key techniques and open issues. IEEE Communications Surveys & Tutorials, 21(4), 3072–3108.

    Article  Google Scholar 

  13. Jung, H., Kim, K., Kim, J., Shin, O., & Shin, Y. (2012). A relay selection scheme using Q-learning algorithm in cooperative wireless communications. In 2012 18th Asia-Pacific Conference on Communications (APCC) (pp. 7–11). IEEE.

  14. Saha, A., Ghosh, A., & Hamouda, W. (2014). Learning-based relay selection for cooperative networks. In 2014 IEEE Global Communications Conference (GLOBECOM) (pp. 386–391). IEEE.

  15. Jadoon, M. A., & Kim, S. (2017). Relay selection Algorithm for wireless cooperative networks: A learning-based approach. IET Communications, 11(7), 1061–1066.

    Article  Google Scholar 

  16. Amiri, R., Almasi, M. A., Andrews, J. G., & Mehrpouyan, H. (2019). Reinforcement learning for self-organization and power control of two-tier heterogeneous networks. IEEE Transactions on Wireless Communications, 18(8), 3933–3947.

    Article  Google Scholar 

  17. Shams, F., Bacci, G., & Luise, M. (2015). Energy-efficient power control for multiple-relay cooperative networks using Q-learning. IEEE Transactions on Wireless Communications, 14(3), 1567–1580.

    Article  Google Scholar 

  18. Wilhelmi, F., Bellalta, B., Cano, C., & Jonsson, A. (2017). Implications of decentralized Q-learning resource allocation in wireless networks. in 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC) (pp. 1–5). IEEE.

  19. Dubev, A., Mallik, R. K., & Schober, R. (2015). Performance analysis of a multi-hop power line communication system over log-normal fading in presence of impulsive noise. IET Communications, 9(1), 1–9.

    Article  Google Scholar 

  20. Su, Y., Lu, X., Zhao, Y., Huang, L., & Du, X. (2019). Cooperative communications with relay selection based on deep reinforcement learning in wireless sensor networks. IEEE Sensors Journal, 19(20), 9561–9569.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronic and Communication Engineering, North China Electric Power University, Baoding, 071003, Hebei, China

    Zhixiong Chen, Honghai Zeng, Miao Yu & Yincheng Qi

  2. Hebei Key Laboratory of Power Internet of Things Technology, North China Electric Power University, Baoding, 071003, Hebei, China

    Zhixiong Chen & Yincheng Qi

Authors
  1. Zhixiong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Honghai Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Miao Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yincheng Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhixiong Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Manuscript received ######, 2020. This work was supported by the National Natural Science Foundation of China (Nos. 61601182 and 61,771,195), Natural Science Foundation of Hebei Province (F2017502059 and F2018502047), and in part by the Fundamental Research Funds for the Central Universities under Grant 2019MS088.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Z., Zeng, H., Yu, M. et al. Adaptive relay strategy selection based on Q-learning for power line and wireless dual-media communication with hybrid duplex. Wireless Netw 27, 3785–3796 (2021). https://doi.org/10.1007/s11276-021-02671-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11276-021-02671-6

Search

Navigation