Abstract:The next generation wireless networks demand full coverage from the sky to the deep ocean, in which the water-air cross-boundary communication is a critical component in a coordinated uncrewed vehicular network that connects both uncrewed aerial vehicles (UAVs) and autonomous underwater vehicles (AUVs). In such a network, optical wireless communication (OWC) is an emerging and promising technology to implement direct high-speed wireless communication through the water-to-air interface. However, due to the high directionality of optical beams and the dynamics of the harsh oceanic environments, it faces significant challenges to achieve reliable and robust seamless cross-boundary communication, as the waves cause beam deflection and the mobility of the transceivers makes the link worse or even results in link disconnections. To deal with these challenges, in this paper, we investigate both static and mobile application scenarios to enable reliable water-air direct optical communications via the deep reinforcement learning (DRL) approaches. In the static scenario, we propose an active alignment method and derive the optimal beamwidth to satisfy the requirement of bit error rate (BER) and improve the link availability. To cope with the oceanic environment-induced channel dynamics, in the mobile scenario, we design a DRL-based UAV control strategy by incorporating the extended Kalman filter (EKF) prediction technique to enhance reliable communication between the mobile transceivers. The numerical simulations demonstrate that the proposed schemes achieve impressive performance in terms of energy consumption and reliable communications under both the static and mobile scenarios.

An Overview of Intelligent Wireless Communications Using Deep Reinforcement Learning

Applications of Deep Reinforcement Learning in Communications and Networking: A Survey

Deep Reinforcement Learning for Intelligent Communications

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Application of deep neural network and deep reinforcement learning in wireless communication

Survey on Reinforcement Learning Applications in Communication Networks.

Deep Reinforcement Learning for Communication Flow Control in Wireless Mesh Networks

Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges

Enabling Urban MmWave Communications with UAV-Carried IRS Via Deep Reinforcement Learning

Application of Deep Reinforcement Learning in UAVs: A Review

Reinforcement Learning Meets Wireless Networks: A Layering Perspective

Toward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based Approaches

Deep Reinforcement Learning-based UAV Control for Optimized Energy Efficiency and Throughput in UAV-assisted Communication

Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial

Toward Safe and Accelerated Deep Reinforcement Learning for Next-Generation Wireless Networks

Deep Reinforcement Learning for Beam Management in UAV Relay mmWave Networks

Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach

Enabling Reliable Water-Air Direct Optical Wireless Communication for Uncrewed Vehicular Networks: A Deep Reinforcement Learning Approach

Intelligent flying-beamformer for hybrid mmWave systems: A deep reinforcement learning approach

Deep Reinforcement Learning With Application to Air Confrontation Intelligent Decision-Making of Manned/Unmanned Aerial Vehicle Cooperative System

Applications of Multi-Agent Deep Reinforcement Learning Communication in Network Management: A Survey