Abstract:Due to the highly dynamic changes in wireless network topologies, efficiently obtaining network status information and flexibly forwarding data to improve communication quality of service are important challenges. This article introduces an intelligent routing algorithm (DRL-PPONSA) based on proximal policy optimization deep reinforcement learning with network situational awareness under a software-defined wireless networking architecture. First, a specific data plane is designed for network topology construction and data forwarding. The control plane collects network traffic information, sends flow tables, and uses a GCN-GRU prediction mechanism to perceive future traffic change trends to achieve network situational awareness. Second, a DRL-based data forwarding mechanism is designed in the knowledge plane. The predicted network traffic matrix and topology information matrix are treated as the environment for DRL agents, while next-hop adjacent nodes are treated as executable actions. Accordingly, action selection strategies are designed for different network conditions to achieve more intelligent, flexible, and efficient routing control. The reward function is designed using network link information and various reward and penalty mechanisms. Additionally, importance sampling and gradient clipping techniques are employed during gradient updating to enhance convergence speed and stability. Experimental results show that DRL-PPONSA outperforms traditional routing methods in network throughput, delay, packet loss rate, and wireless node distance. Compared to value-function-based Dueling DQN routing, the convergence speed is significantly improved, and the convergence effect is more stable. Simultaneously, its consumption of hardware storage space is reduced, and efficient routing decisions can be made in real-time using the current network state information.

An Intelligent Routing Mechanism Based on Deep Reinforcement Learning

QoS Routing Optimization Based on Deep Reinforcement Learning in SDN

Intelligent Routing Algorithm over SDN: Reusable Reinforcement Learning Approach

A Hybrid Deep Reinforcement Learning Routing Method under Dynamic and Complex Traffic with Software Defined Networking

An Intelligent SDWN Routing Algorithm Based on Network Situational Awareness and Deep Reinforcement Learning

Deep Reinforcement Learning for On-demand Intelligent Routing in Deterministic Networks

Enabling Scalable Routing in Software-Defined Networks With Deep Reinforcement Learning on Critical Nodes

Improving the Scalability of Deep Reinforcement Learning-Based Routing with Control on Partial Nodes

A Routing Optimization Method for Software-Defined SGIN Based on Deep Reinforcement Learning

Deep Graph Reinforcement Learning Based Intelligent Traffic Routing Control for Software-Defined Wireless Sensor Networks

Adaptive and Robust Network Routing Based on Deep Reinforcement Learning with Lyapunov Optimization.

Deep Q-Learning for Routing Schemes in SDN-Based Data Center Networks

Towards Cognitive Routing based on Deep Reinforcement Learning

Intelligent Routing Strategy in the Internet of Things Based on Deep Reinforcement Learning

DROM: Optimizing the Routing in Software-Defined Networks with Deep Reinforcement Learning

Routing Optimization With Deep Reinforcement Learning in Knowledge Defined Networking

A Deep Reinforcement Learning Approach for Adaptive Traffic Routing in Next-gen Networks

Traffic Engineering in Hybrid Software Defined Network Via Reinforcement Learning

Research on deep reinforcement learning multi-path routing planning in SDN

Enabling efficient routing for traffic engineering in SDN with Deep Reinforcement Learning

Optimizing Network Performance with AI-Enabled Adaptive Routing in SDN