Abstract:Due to the highly dynamic changes in wireless network topologies, efficiently obtaining network status information and flexibly forwarding data to improve communication quality of service are important challenges. This article introduces an intelligent routing algorithm (DRL-PPONSA) based on proximal policy optimization deep reinforcement learning with network situational awareness under a software-defined wireless networking architecture. First, a specific data plane is designed for network topology construction and data forwarding. The control plane collects network traffic information, sends flow tables, and uses a GCN-GRU prediction mechanism to perceive future traffic change trends to achieve network situational awareness. Second, a DRL-based data forwarding mechanism is designed in the knowledge plane. The predicted network traffic matrix and topology information matrix are treated as the environment for DRL agents, while next-hop adjacent nodes are treated as executable actions. Accordingly, action selection strategies are designed for different network conditions to achieve more intelligent, flexible, and efficient routing control. The reward function is designed using network link information and various reward and penalty mechanisms. Additionally, importance sampling and gradient clipping techniques are employed during gradient updating to enhance convergence speed and stability. Experimental results show that DRL-PPONSA outperforms traditional routing methods in network throughput, delay, packet loss rate, and wireless node distance. Compared to value-function-based Dueling DQN routing, the convergence speed is significantly improved, and the convergence effect is more stable. Simultaneously, its consumption of hardware storage space is reduced, and efficient routing decisions can be made in real-time using the current network state information.

Multi-Agent DRL-Based Deadline-Aware Routing for Deterministic Wide-Area Networks

Deep Distributional Reinforcement Learning-Based Adaptive Routing with Guaranteed Delay Bounds

Toward Packet Routing With Fully Distributed Multiagent Deep Reinforcement Learning

Toward Packet Routing with Fully-distributed Multi-agent Deep Reinforcement Learning

Deadline-Constrained Multi-Agent Collaborative Transmission for Delay-Sensitive Applications

Multi-Agent DRL for Distributed Routing and Data Scheduling in Interplanetary Networks

Deep Reinforcement Learning for On-demand Intelligent Routing in Deterministic Networks

Deep Reinforcement Learning based Routing for Non-cooperative Multi-flow Games in Dynamic AANETs

Multiagent Deep Reinforcement Learning for Cost- and Delay-Sensitive Virtual Network Function Placement and Routing

Deep Reinforcement Learning Based Dynamic Routing Optimization for Delay-Sensitive Applications

Deep Reinforcement Learning-Based Deterministic Routing and Scheduling for Mixed-Criticality Flows

Learning Multi-agent Communication under Limited-bandwidth Restriction for Internet Packet Routing

RTHop: Real-Time Hop-by-Hop Mobile Network Routing by Decentralized Learning With Semantic Attention

Intelligent multicast routing method based on multi-agent deep reinforcement learning in SDWN

Load-Aware Distributed Resource Allocation for MF-TDMA Ad Hoc Networks: A Multi-Agent DRL Approach.

Fully-Distributed Dynamic Packet Routing for LEO Satellite Networks: A GNN-Enhanced Multi-Agent Reinforcement Learning Approach

A Novel Multi-Objective Routing Scheme Based on Cooperative Multi-Agent Reinforcement Learning for Metaverse Services in Fixed 6G.

Energy-efficient and delay-guaranteed routing algorithm for software-defined wireless sensor networks: A cooperative deep reinforcement learning approach

Learning Based Deadline Aware Congestion Control

An Intelligent SDWN Routing Algorithm Based on Network Situational Awareness and Deep Reinforcement Learning

Multi-Agent Driven Resource Allocation and Interference Management for Deep Edge Networks