Abstract:Underwater acoustic wireless sensor networks (UAWSNs) are being confess as a valuable tool for studying and monitoring aquatic environments. However, the unique characteristics of acoustic communication in UAWSNs present significant challenges. These challenges include high latency, which refers to delays in transmitting data, low available bandwidth, which limits the amount of data that can be transmitted, and a high bit error rate, which refers to errors that occur during the transmission of data. Addressing these aforementioned challenges is critical to the successful deployment and operation of UAWSNs for environmental monitoring and other applications. Contention-based medium access control (MAC) protocols are not suited for use in UAWSNs because to their lower efficiency as compared to terrestrial networks because of the distinctive attributes of UAWSNs. To address this issue, a contention-free MAC protocol is deemed more suitable, as it offers greater reliability and flexibility in overcoming the challenges posed by acoustic signals. This protocol may also increase the network's throughput and energy efficiency by removing the potential of collisions, thereby achieving high performance. In this research, we proposed a new multi-hop energy-efficient and low collision MAC protocol using Q-learning technique for UAWSNs. The proposed MAC protocol is designed to address the challenges of UAWSNs, such as low available bandwidth, high latency, and high bit error rate. By utilizing a Q-learning approach, the protocol is able to make informed decisions in selecting the optimal communication path while minimizing energy consumption and reducing the occurrence of collisions. This is achieved through a multi-hop approach that allows for efficient data transmission across the network. The protocol's energy efficiency and collision avoidance capabilities make it a promising candidate for use in various underwater applications, including environmental monitoring, underwater surveillance, and exploration. The simulation results demonstrate that the suggested MAC protocol outperformed other schemes in terms of throughput, collision rates, and energy efficiency. This suggests that the suggested approach is successful in fixing the problems with UAWSNs and may enhance the performance of the entire network.

Q-Learning Based Multi-Channel Aware Routing Protocol for Optical-Acoustic Hybrid Underwater Wireless Sensor Network

A Cooperative Routing Protocol Based on Q-Learning for Underwater Optical-Acoustic Hybrid Wireless Sensor Networks

A Q-Learning-Based Hierarchical Routing Protocol with Unequal Clustering for Underwater Acoustic Sensor Networks

QMCR: A Q-learning-based Multi-Hop Cooperative Routing Protocol for Underwater Acoustic Sensor Networks

A Power Control-Aided Q-Learning-Based Routing Protocol for Optical-Acoustic Hybrid Underwater Sensor Networks

Source-based Disjoint Multi-Path Routing Protocol for Underwater Acoustic Networks

SQMCR: Stackelberg Q-Learning-Based Multi-Hop Cooperative Routing Algorithm for Underwater Wireless Sensor Networks

A Multi-Agent Reinforcement Learning Routing Protocol for Underwater Optical Sensor Networks

Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning Approach.

QLACO: Q-learning Aided Ant Colony Routing Protocol for Underwater Acoustic Sensor Networks

Cross-Layer Routing Protocol Based on Channel Quality for Underwater Acoustic Communication Networks

A Q-Learning and Data Priority-Based Routing Protocol with Dynamic Computing Cluster Head for Underwater Acoustic Sensor Networks

Q-Learning Based Routing Optimization Algorithm for Underwater Sensor Networks

Q Learning-Based Routing Protocol with Accelerating Convergence for Underwater Wireless Sensor Networks

Energy Efficient Routing for Multi-modal Underwater Wireless Sensor Networks

Multimodal Acoustic-RF Adaptive Routing Protocols for Underwater Wireless Sensor Networks

QAAR: an Application-Adaptive Routing Protocol Based on Q-Learning in Underwater Sensor Networks

Reinforcement Learning-Based Adaptive Switching Scheme for Hybrid Optical-Acoustic AUV Mobile Network

Anypath Routing Protocol Design via Q-Learning for Underwater Sensor Networks

Q-Learning Based Dynamic Cooperative Communication in Time Varying Underwater Acoustic Channels.

A Q-Learning-Based Multi-Hop Energy-Efficient and Low Collision MAC Protocol for Underwater Acoustic Wireless Sensor Networks