Abstract:As the demand for sensing and monitoring the marine environment increases, the Ocean Mobile Internet of Things (OM-IoT) has gradually attracted the interest of researchers. However, the unreliability of communication links represents a significant challenge to data transmission in the OM-IoT, given the complex and dynamic nature of the marine environment, the mobility of nodes, and other factors. Consequently, it is necessary to enhance the reliability of underwater data transmission. To address this issue, this paper proposes a reinforcement learning-based adaptive network coding (RL-ANC) approach. Firstly, the channel conditions are estimated based on the reception acknowledgment, and a feedback-independent decoding state estimation method is proposed. Secondly, the sliding coding window is dynamically adjusted based on the estimates of the channel erasure probability and decoding probability, and the sliding rule is adaptively determined using a reinforcement learning algorithm and an enhanced greedy strategy. Subsequently, an adaptive optimization method for coding coefficients based on reinforcement learning is proposed to enhance the reliability of the underwater data transmission and underwater network coding while reducing the redundancy in the coding. Finally, the sampling period and time slot table are updated using the enhanced simulated annealing algorithm to optimize the accuracy and timeliness of the channel estimation. Simulation experiments demonstrate that the proposed method effectively enhances the data transmission reliability in unreliable communication links, improves the performance of underwater network coding in terms of the packet delivery rate, retransmission, and redundancy transmission ratios, and accelerates the convergence speed of the decoding probability.

Reinforcement Learning-Based Adaptive Modulation and Coding for Efficient Underwater Communications.

Adaptive Modulation and Coding for Underwater Acoustic Communication Based on Neural Networks

Adaptive Underwater Acoustic OFDM Modulation Method Based on Improved Deep Reinforcement Learning

Deep Reinforcement Learning-Based Adaptive Modulation for OFDM Underwater Acoustic Communication System

Reinforcement Learning-Based Adaptive Network Coding in the Ocean Mobile Internet of Things

Underwater Acoustic Adaptive Modulation with Reinforcement Learning and Channel Prediction

Reinforcement Learning Based Efficient Underwater Image Communication

Reinforcement Learning-Based Adaptive Modulation Scheme over Underwater Acoustic OFDM Communication Channels

Adaptive Transmission for Underwater Acoustic Communication Based on Deep Reinforcement Learning

Adaptive Modulation and Coding for Underwater Acoustic Communications Based on Data-Driven Learning Algorithm

Reinforcement Learning Based QoS-Aware Anti-Jamming Underwater Video Transmission

Adaptive modulation switching strategy based on Q-learning for underwater acoustic communication channel.

Analysis of Mode Switching Metrics for Deep Reinforcement Learning-Based Adaptive Modulation

Anti-Jamming Underwater Transmission with Mobility and Learning.

Deep Reinforcement Learning-Based Adaptive Modulation for Underwater Acoustic Communication with Outdated Channel State Information

Adaptive Retransmission Scheme for Underwater Acoustic Nodes Based on Distance Ranging

Reinforcement-Learning-Based Relay Mobility and Power Allocation for Underwater Sensor Networks Against Jamming

Deep Reinforcement Learning Based Cognitive Equalization Algorithm Research in Underwater Communication

Intelligent Maritime Communications Enabled By Deep Reinforcement Learning

Adaptive Power Allocation for Non-coherent FSK in Time-varying Underwater Acoustic Communication Channels.

An Efficient Routing Access Method Based on Multi-Agent Reinforcement Learning in UWSNs