Abstract:Wireless Sensor Networks (WSN) are a crucial part of the Internet of Things (IoT), and research on WSN routing protocols has always been a hot topic in academia. However, traditional WSN routing protocols have limited utilization of available information during the routing decision process, leading to challenges such as insufficient adaptability to network topology changes, high communication delays, and short network lifetimes. To address these issues, this paper proposes an innovative intelligent routing algorithm WOAD3QN-RP, which cleverly integrates swarm intelligence algorithms and deep reinforcement learning. The WOAD3QN-RP not only effectively reduces delay but also balances energy consumption and flexibly adapts to changes in network topology, while simultaneously determining the optimal multi-hop path, effectively extending the lifetime of the network. Firstly, the WOAD3QN-RP algorithm employs the Whale Optimization Algorithm (WOA) to determine the optimal cluster heads (CHs). In the process of selecting CHs, the algorithm comprehensively considers key factors such as the residual energy of nodes, node distance, and communication delay, thereby significantly improving the accuracy and efficiency of CH selection, which contributes to better energy distribution and performance of the network. Secondly, in terms of multi-hop path selection, WOAD3QN-RP uses a dueling double deep Q -network (D3QN) to determine the optimal multi-hop path. Through utilizing neural networks to interact with the environment, intelligent agents are trained to learn routing policies to adapt to dynamic changes in the network topology and ensure the balance between energy consumption and multi-hop routing performance. Experimental results show that WOAD3QN-RP exhibits significant advantages over existing routing protocols in terms of network lifetime, energy efficiency, and communication delay.

QAAR: an Application-Adaptive Routing Protocol Based on Q-Learning in Underwater Sensor Networks

Anypath Routing Protocol Design via Q-Learning for Underwater Sensor Networks

A Q-Learning-Based Hierarchical Routing Protocol with Unequal Clustering for Underwater Acoustic Sensor Networks

ADRP-DQL: An adaptive distributed routing protocol for underwater acoustic sensor networks using deep Q-learning

A Heterogeneous Network with Multiple Routing Protocols for Autonomous Underwater Vehicles

QLACO: Q-learning Aided Ant Colony Routing Protocol for Underwater Acoustic Sensor Networks

Sea Experiment for Mobile Underwater Acoustic Networks

Sea Experiment for Mobile Underwater Acoustic Networks Extended Abstract

SQMCR: Stackelberg Q-Learning-Based Multi-Hop Cooperative Routing Algorithm for Underwater Wireless Sensor Networks

Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning Approach.

Q-Learning Based Multi-Channel Aware Routing Protocol for Optical-Acoustic Hybrid Underwater Wireless Sensor Network

A Cooperative Routing Protocol Based on Q-Learning for Underwater Optical-Acoustic Hybrid Wireless Sensor Networks

RQAR: Location‐free reliable and QoS‐aware routing protocol for mobile sink underwater wireless sensor networks

An Adaptive Multi-Zone Geographic Routing Protocol for Underwater Acoustic Sensor Networks

Delay and Queue Aware Adaptive Scheduling- Based MAC Protocol for Underwater Acoustic Sensor Networks

Source-based Disjoint Multi-Path Routing Protocol for Underwater Acoustic Networks

UWIA-AODV: Improved Ad-Hoc On-Demand Distance Vector Routing Protocol for Underwater Acoustic Sensor Networks

An end-to-end sensor scheduling method based on D3QN for underwater passive tracking in UWSNs

WOAD3QN-RP: An intelligent routing protocol in wireless sensor networks — A swarm intelligence and deep reinforcement learning based approach

Energy Efficient Routing for Multi-modal Underwater Wireless Sensor Networks

A Survey of Routing Protocols for Underwater Wireless Sensor Networks