Abstract:With the development of the underwater acoustic (UWA) adaptive communication system, energy-efficient transmission has become a critical topic in underwater acoustic (UWA) communications. Due to the unique characteristics of the underwater environment, the transmitter node will almost always have outdated channel state information (CSI), which results in low energy efficiency. In this paper, we take full advantage of bidirectional links and propose an adaptive modulation and coding (AMC) scheme that aims to maximize the long-term energy efficiency of a single link by jointly scheduling the coding rate, modulation order, and transmission power. Considering the complexity characteristics of UWA channels, we proposed a bit error ratio (BER) estimation method based on deep neural networks (DNN). The proposed network could realize channel estimation, feature extraction, and BER estimation by using a fixed pilot of the feedback link. Then, we design a channel classification method based on the estimated BERs of the modulation and coding scheme (MCS) and further model the UWA channels as a finite-state Markov chain (FSMC) with an unknown transition probability. Thus, we formulate the AMC problem as a Markov Decision Process (MDP) and solve it through a reinforcement learning framework. Considering the large state-action pairs, a double deep Q-network (DDQN) based scheme is proposed. Simulation results demonstrate that the proposed AMC scheme outperforms the fixed MCS with a perfect channel information state, and achieves near-optimal energy efficiency.

Adaptive Transmission for Underwater Acoustic Communication Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Energy Efficient Underwater Acoustic Communications

Adaptive Switching for Multimodal Underwater Acoustic Communications Based on Reinforcement Learning

Adaptive Modulation and Coding for Underwater Acoustic Communications Based on Data-Driven Learning Algorithm

Reinforcement Learning-Based Adaptive Modulation and Coding for Efficient Underwater Communications.

Deep Reinforcement Learning-Based Adaptive Modulation for Underwater Acoustic Communication with Outdated Channel State Information

Adaptive Modulation and Coding for Underwater Acoustic Communication Based on Neural Networks

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Reinforcement Learning Based Efficient Underwater Image Communication

Exploiting Propagation Delay in Underwater Acoustic Communication Networks via Deep Reinforcement Learning

Adaptive Retransmission Scheme for Underwater Acoustic Nodes Based on Distance Ranging

Adaptive Power Allocation for Non-coherent FSK in Time-varying Underwater Acoustic Communication Channels.

Deep Reinforcement Learning Based Optical and Acoustic Dual Channel Multiple Access in Heterogeneous Underwater Sensor Networks

A Hierarchical Deep-Reinforcement Approach

Deep Reinforcement Learning Based Time-Domain Interference Alignment Scheduling for Underwater Acoustic Networks

Deep Learning Based Single Carrier Communications Over Time-Varying Underwater Acoustic Channel

Asynchronous Amplify-and-forward Relay Communications for Underwater Acoustic Networks.

Power and Interference Control for VLC-Based UDN: A Reinforcement Learning Approach.

Reinforcement Learning Based Relay Selection for Underwater Acoustic Cooperative Networks

Adaptive Coding and Bit-Power Loading Algorithms for Underwater Acoustic Transmissions

AUV-Aided Optical-Acoustic Hybrid Data Collection Based on Deep Reinforcement Learning