Abstract:With the advancements in wireless sensor networks and the Internet of Underwater Things (IoUT), underwater acoustic sensor networks (UASNs) have attracted much attention, which has also been widely used in marine engineering exploration and disaster prevention. However, UASNs still face many challenges, including high propagation latency, limited bandwidth, high energy consumption, and unreliable transmission, influencing the good quality of service (QoS). In this paper, we propose a routing protocol based on the on-site architecture (SROA) for UASNs to improve network scalability and energy efficiency. The on-site architecture adopted by SROA is different from most architectures in that the data center is deployed underwater, which makes the sink nodes closer to the data source. A clustering method is introduced in SROA, which makes the network adapt to the changes in the network scale and avoid single-point failure. Moreover, the Q-learning algorithm is applied to seek optimal routing policies, in which the characteristics of underwater acoustic communication such as residual energy, end-to-end delay, and link quality are considered jointly when constructing the reward function. Furthermore, the reduction of packet retransmissions and collisions is advocated using a waiting mechanism developed from opportunistic routing (OR). The SROA realizes opportunistic routing to choose candidate nodes and coordinate packet forwarding among candidate nodes. The scalability of the proposed routing protocols is also analyzed by varying the network size and transmission range. According to the evaluation results, with the network scale ranging from 100 to 500, the SROA outperforms the existing routing protocols, extensively decreasing energy consumption and end-to-end delay.

A Multi-Agent Reinforcement Learning Routing Protocol for Underwater Optical Sensor Networks

Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning Approach.

Multi-Agent Reinforcement Learning-Based Routing Protocol for Underwater Wireless Sensor Networks with Value of Information

Adaptive Clustering Routing Protocol for Underwater Sensor Networks

A Cooperative Routing Protocol Based on Q-Learning for Underwater Optical-Acoustic Hybrid Wireless Sensor Networks

Reinforcement Learning-Based Opportunistic Routing Protocol for Underwater Acoustic Sensor Networks

Source-based Disjoint Multi-Path Routing Protocol for Underwater Acoustic Networks

Q-Learning Based Multi-Channel Aware Routing Protocol for Optical-Acoustic Hybrid Underwater Wireless Sensor Network

QMCR: A Q-learning-based Multi-Hop Cooperative Routing Protocol for Underwater Acoustic Sensor Networks

An Efficient Routing Access Method Based on Multi-Agent Reinforcement Learning in UWSNs

An Adaptive Multi-Zone Geographic Routing Protocol for Underwater Acoustic Sensor Networks

Energy Efficient Routing for Multi-modal Underwater Wireless Sensor Networks

Q-Learning Based Routing Optimization Algorithm for Underwater Sensor Networks

A Reinforcement-Learning-Based Opportunistic Routing Protocol for Energy-Efficient and Void-Avoided UASNs

MLRS-RL: an Energy-Efficient Multilevel Routing Strategy Based on Reinforcement Learning in Multimodal UWSNs

A Multi-agent Reinforcement Learning Routing Protocol in Mobile Robot Network

CLORP: Cross-Layer Opportunistic Routing Protocol for Underwater Sensor Networks Based on Multi-Agent Reinforcement Learning

Q Learning-Based Routing Protocol with Accelerating Convergence for Underwater Wireless Sensor Networks

Reinforcement Learning-Based Opportunistic Routing Protocol using Depth Information for Energy-efficient Underwater Wireless Sensor Networks

Multi-Agent Distributed Cooperative Routing for Maritime Emergency Communication.

An On-Site-Based Opportunistic Routing Protocol for Scalable and Energy-Efficient Underwater Acoustic Sensor Networks