Abstract:Due to the highly dynamic changes in wireless network topologies, efficiently obtaining network status information and flexibly forwarding data to improve communication quality of service are important challenges. This article introduces an intelligent routing algorithm (DRL-PPONSA) based on proximal policy optimization deep reinforcement learning with network situational awareness under a software-defined wireless networking architecture. First, a specific data plane is designed for network topology construction and data forwarding. The control plane collects network traffic information, sends flow tables, and uses a GCN-GRU prediction mechanism to perceive future traffic change trends to achieve network situational awareness. Second, a DRL-based data forwarding mechanism is designed in the knowledge plane. The predicted network traffic matrix and topology information matrix are treated as the environment for DRL agents, while next-hop adjacent nodes are treated as executable actions. Accordingly, action selection strategies are designed for different network conditions to achieve more intelligent, flexible, and efficient routing control. The reward function is designed using network link information and various reward and penalty mechanisms. Additionally, importance sampling and gradient clipping techniques are employed during gradient updating to enhance convergence speed and stability. Experimental results show that DRL-PPONSA outperforms traditional routing methods in network throughput, delay, packet loss rate, and wireless node distance. Compared to value-function-based Dueling DQN routing, the convergence speed is significantly improved, and the convergence effect is more stable. Simultaneously, its consumption of hardware storage space is reduced, and efficient routing decisions can be made in real-time using the current network state information.

An Intelligent Routing Algorithm for LEO Satellites Based on Deep Reinforcement Learning

Reinforcement learning based dynamic distributed routing scheme for mega LEO satellite networks

Deep Reinforcement Learning for Congestion Control and Routing Optimization in LEO Satellite Networks

SDDRL-SR: A High-Reliability Satellite Routing Algorithm Based on Deep Reinforcement Learning

Reinforcement Learning Based Intelligent Routing for Software Defined LEO Satellite Networks

Routing Algorithm for AD Hoc Networks of LEO Satellites Based on OSPF

Multi-Commodity Flow Routing for Large-Scale LEO Satellite Networks Using Deep Reinforcement Learning

On An Intelligent Hierarchical Routing Strategy for Ultra-Dense Free Space Optical Low Earth Orbit Satellite Networks

Dynamic Routing Planning Method for Large-Scale Low-Orbit Satellite Networks Based on Location Guided and Multi-Agent DQN Network

GRouting: Dynamic Routing for LEO Satellite Networks with Graph-based Deep Reinforcement Learning

A DRL Empowered Multipath Cooperative Routing for Ultra-Dense LEO Satellite Networks

Enabling High-Throughput Routing for LEO Satellite Broadband Networks: A Flow-Centric Deep Reinforcement Learning Approach

Spatial Location Aided Fully-Distributed Dynamic Routing for Large-Scale LEO Satellite Networks

Fast-Convergence Reinforcement Learning for Routing in LEO Satellite Networks

Deep-Reinforcement-Learning-Based Intelligent Routing Strategy for FANETs

An Intelligent SDWN Routing Algorithm Based on Network Situational Awareness and Deep Reinforcement Learning

Routing Algorithm with Virtual Topology Toward to Huge Numbers of LEO Mobile Satellite Network Based on SDN

Graph Neural Network and Reinforcement Learning Based Routing for Mega LEO Satellite Constellations

A robust routing strategy based on deep reinforcement learning for mega satellite constellations

Knowledge Graph Aided Network Representation and Routing Algorithm for LEO Satellite Networks

Multi-Agent Deep Reinforcement Learning for Distributed Satellite Routing