Abstract:Due to the highly dynamic changes in wireless network topologies, efficiently obtaining network status information and flexibly forwarding data to improve communication quality of service are important challenges. This article introduces an intelligent routing algorithm (DRL-PPONSA) based on proximal policy optimization deep reinforcement learning with network situational awareness under a software-defined wireless networking architecture. First, a specific data plane is designed for network topology construction and data forwarding. The control plane collects network traffic information, sends flow tables, and uses a GCN-GRU prediction mechanism to perceive future traffic change trends to achieve network situational awareness. Second, a DRL-based data forwarding mechanism is designed in the knowledge plane. The predicted network traffic matrix and topology information matrix are treated as the environment for DRL agents, while next-hop adjacent nodes are treated as executable actions. Accordingly, action selection strategies are designed for different network conditions to achieve more intelligent, flexible, and efficient routing control. The reward function is designed using network link information and various reward and penalty mechanisms. Additionally, importance sampling and gradient clipping techniques are employed during gradient updating to enhance convergence speed and stability. Experimental results show that DRL-PPONSA outperforms traditional routing methods in network throughput, delay, packet loss rate, and wireless node distance. Compared to value-function-based Dueling DQN routing, the convergence speed is significantly improved, and the convergence effect is more stable. Simultaneously, its consumption of hardware storage space is reduced, and efficient routing decisions can be made in real-time using the current network state information.

An Intelligent Routing Algorithm Based on Prioritized Replay Double DQN for MANET

An adaptive intelligent routing algorithm based on deep reinforcement learning

Adaptive Ant-Based Dynamic Routing Algorithm

Performance Comparison and Analysis of Routing Strategies in Mobile Ad Hoc Networks

DDQN with Prioritized Experience Replay-Based Optimized Geographical Routing Protocol of Considering Link Stability and Energy Prediction for UANET

An Intelligent SDWN Routing Algorithm Based on Network Situational Awareness and Deep Reinforcement Learning

DQN Based Anti-blocking Routing Algorithm for IRS-assisted MANET

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

Deep Reinforcement Learning for Router Selection in Network with Heavy Traffic

DDQN Based Routing Algorithm for IRS-Assisted MANET Without Explicit CSI

An Intersection-Based Traffic Awareness Routing Protocol in VANETs Using Deep Reinforcement Learning

An Integrated DQN and RF Packet Routing Framework for the V2X Network

Real-time routing algorithm for mobile ad hoc networks using reinforcement learning and heuristic algorithms

Deep Reinforcement Learning Aided Packet-Routing For Aeronautical Ad-Hoc Networks Formed by Passenger Planes

Deep-Reinforcement-Learning-Based Intelligent Routing Strategy for FANETs

Delay-Aware and Link-Quality-Aware Geographical Routing Protocol for UANET via Dueling Deep Q-Network

A Deep Reinforcement Learning-based Routing Scheme with Two Modes for Dynamic Networks

(Pr)-R-3: Realizing Robust Routing For Vanet Using Trajectory Prediction And Crossroad Recognition

A New Anti-Jamming Strategy Based on Deep Reinforcement Learning for MANET

Toward Packet Routing With Fully Distributed Multiagent Deep Reinforcement Learning