Abstract:Due to the highly dynamic changes in wireless network topologies, efficiently obtaining network status information and flexibly forwarding data to improve communication quality of service are important challenges. This article introduces an intelligent routing algorithm (DRL-PPONSA) based on proximal policy optimization deep reinforcement learning with network situational awareness under a software-defined wireless networking architecture. First, a specific data plane is designed for network topology construction and data forwarding. The control plane collects network traffic information, sends flow tables, and uses a GCN-GRU prediction mechanism to perceive future traffic change trends to achieve network situational awareness. Second, a DRL-based data forwarding mechanism is designed in the knowledge plane. The predicted network traffic matrix and topology information matrix are treated as the environment for DRL agents, while next-hop adjacent nodes are treated as executable actions. Accordingly, action selection strategies are designed for different network conditions to achieve more intelligent, flexible, and efficient routing control. The reward function is designed using network link information and various reward and penalty mechanisms. Additionally, importance sampling and gradient clipping techniques are employed during gradient updating to enhance convergence speed and stability. Experimental results show that DRL-PPONSA outperforms traditional routing methods in network throughput, delay, packet loss rate, and wireless node distance. Compared to value-function-based Dueling DQN routing, the convergence speed is significantly improved, and the convergence effect is more stable. Simultaneously, its consumption of hardware storage space is reduced, and efficient routing decisions can be made in real-time using the current network state information.

Stochastic Adaptive Forwarding Strategy Based on Deep Reinforcement Learning for Secure Mobile Video Communications in NDN.

SAF: Stochastic Adaptive Forwarding in Named Data Networking

DRL-based Forwarding Strategy in Named Data Networking

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

Intelligent Forwarding Strategy Based on Online Machine Learning in Named Data Networking.

A stochastic optimization approach for dynamic adaptive scalable video streaming over NDN

AFSndn: A novel adaptive forwarding strategy in named data networking based on Q-learning

Reinforcement Learning Based Dynamic Adaptive Video Streaming for Multi-client over NDN

Dynamic Adaptive Streaming Control Based on Deep Reinforcement Learning in Named Data Networking

Joint Faces Scheduling and Bitrate Switching for Dynamic Adaptive Streaming over NDN Based on Stochastic Optimization

Reliable Forwarding Strategy Based on Multiple Attribute Decision-Making in NDN-Ad Hoc Networks

Learning an adaptive forwarding strategy for mobile wireless networks: resource usage vs. latency

IFS-RL

An Intelligent SDWN Routing Algorithm Based on Network Situational Awareness and Deep Reinforcement Learning

A Novel Joint Adaptive Forwarding And Resource Allocation Strategy For Named Data Networking Based On Smdp

Design of decision-based selective provider aware forwarding strategy in tactical NDN

Safe Exploration in Wireless Security: A Safe Reinforcement Learning Algorithm With Hierarchical Structure

IEACC: an Intelligent Edge-Aided Congestion Control Scheme for Named Data Networking with Deep Reinforcement Learning.

A Deep Reinforcement Learning Based Congestion Control Mechanism for NDN.

Adaptive Video Streaming Using Dynamic NDN Multicast in WLAN

A Receiver-Driven Named Data Networking (NDN) Congestion Control Method Based on Reinforcement Learning