当前位置: X-MOL 学术J. Netw. Comput. Appl. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Deep Q-Network and Traffic Prediction based Routing Optimization in Software Defined Networks
Journal of Network and Computer Applications ( IF 7.7 ) Pub Date : 2021-08-13 , DOI: 10.1016/j.jnca.2021.103181
EL Hocine Bouzidi 1, 2 , Abdelkader Outtagarts 1 , Rami Langar 2, 3 , Raouf Boutaba 4
Affiliation  

Software Defined Networking (SDN) is gaining momentum not only in research but also in IT industry representing the drivers of 5G networks, due to its capabilities of increasing the flexibility of a network and address a variety of network challenges, by logically centralizing the intelligence in software-based controllers. Thanks to Machine Learning (ML) techniques, the network performances and utilization can be optimized and enhanced. Neural Networks (NN) and Reinforcement Learning (RL), in particular, have demonstrated great success in cooperating with complex problems arising in network operation and management. To this end, we exploit in this paper, an SDN-based rules placement approach that aims to dynamically predict the traffic congestion by using mainly NN and learn optimal paths and reroute traffic to improve network utilization by deploying a Deep Q-Network (DQN) agent. To this end, we first formulate the Quality-of-Service (QoS)-aware routing problem as a Linear Program (LP), whose objective is to minimize the end-to-end (E2E) delay and link utilization. Then, we propose a simple yet efficient heuristic algorithm to solve it. Numerical results through emulation using ONOS controller and Mininet demonstrate that the proposed approach can significantly improve network performances in terms of decreasing the link utilization, the packet loss and the E2E delay.



中文翻译:

软件定义网络中基于深度 Q 网络和流量预测的路由优化

软件定义网络 (SDN) 不仅在研究中而且在代表 5G 网络驱动力的 IT 行业中都获得了动力,因为它能够通过在逻辑上集中智能来提高网络的灵活性并解决各种网络挑战。基于软件的控制器。借助机器学习 (ML) 技术,可以优化和增强网络性能和利用率。尤其是神经网络 (NN) 和强化学习 (RL),在合作解决网络运营和管理中出现的复杂问题方面取得了巨大成功。为此,我们在本文中利用,一种基于 SDN 的规则放置方法,旨在通过主要使用 NN 来动态预测交通拥堵,并通过部署深度 Q 网络 (DQN) 代理学习最佳路径和重新路由流量以提高网络利用率。为此,我们首先将服务质量 (QoS) 感知路由问题表述为线性规划 (LP),其目标是最小化端到端 (E2E) 延迟和链路利用率。然后,我们提出了一个简单而有效的启发式算法来解决它。通过使用 ONOS 控制器和 Mininet 进行仿真的数值结果表明,所提出的方法可以在降低链路利用率、丢包率和 E2E 延迟方面显着提高网络性能。我们首先将服务质量 (QoS) 感知路由问题表述为线性规划 (LP),其目标是最小化端到端 (E2E) 延迟和链路利用率。然后,我们提出了一个简单而有效的启发式算法来解决它。通过使用 ONOS 控制器和 Mininet 进行仿真的数值结果表明,所提出的方法可以在降低链路利用率、丢包率和 E2E 延迟方面显着提高网络性能。我们首先将服务质量 (QoS) 感知路由问题表述为线性规划 (LP),其目标是最小化端到端 (E2E) 延迟和链路利用率。然后,我们提出了一个简单而有效的启发式算法来解决它。通过使用 ONOS 控制器和 Mininet 进行仿真的数值结果表明,所提出的方法可以在降低链路利用率、丢包率和 E2E 延迟方面显着提高网络性能。

更新日期:2021-08-19
down
wechat
bug