Abstract:In this paper, we present a novel distributed UAVs beam reforming approach to dynamically form and reform a space-selective beam path in addressing the coexistence with satellite and terrestrial communications. Despite the unique advantage to support wider coverage in UAV-enabled cellular communications, the challenges reside in the array responses' sensitivity to random rotational motion and the hovering nature of the UAVs. A model-free reinforcement learning (RL) based unified UAV beam selection and tracking approach is presented to effectively realize the dynamic distributed and collaborative beamforming. The combined impact of the UAVs' hovering and rotational motions is considered while addressing the impairment due to the interference from the orbiting satellites and neighboring networks. The main objectives of this work are two-fold: first, to acquire the channel awareness to uncover its impairments; second, to overcome the beam distortion to meet the quality of service (QoS) requirements. To overcome the impact of the interference and to maximize the beamforming gain, we define and apply a new optimal UAV selection algorithm based on the brute force criteria. Results demonstrate that the detrimental effects of the channel fading and the interference from the orbiting satellites and neighboring networks can be overcome using the proposed approach. Subsequently, an RL algorithm based on Deep Q-Network (DQN) is developed for real-time beam tracking. By augmenting the system with the impairments due to hovering and rotational motion, we show that the proposed DQN algorithm can reform the beam in real-time with negligible error. It is demonstrated that the proposed DQN algorithm attains an exceptional performance improvement. We show that it requires a few iterations only for fine-tuning its parameters without observing any plateaus irrespective of the hovering tolerance.

Learning-Enabled Radar-Assisted Predictive Beamforming for UAV-Aided Networks

Location-aware Predictive Beamforming for UAV Communications: A Deep Learning Approach

Communication and Trajectory Design in UAV-enabled Flying Network.

Distributed 3D-Beam Reforming for Hovering-Tolerant UAVs Communication over Coexistence: A Deep-Q Learning for Intelligent Space-Air-Ground Integrated Networks

Intelligent flying-beamformer for hybrid mmWave systems: A deep reinforcement learning approach

Joint Trajectory and Passive Beamforming Design for Intelligent Reflecting Surface-Aided UAV Communications: A Deep Reinforcement Learning Approach

Learning-Based Predictive Beamforming for UAV Communications with Jittering

Deep Reinforcement Learning for Joint Trajectory Planning, Transmission Scheduling, and Access Control in UAV-Assisted Wireless Sensor Networks

A Deep-NN Beamforming Approach for Dual Function Radar-Communication THz UAV

UAV-enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning

Radio Resource Management for Cellular-Connected UAV: A Learning Approach

The Transmission Scheme for UAV MIMO System Based on Reinforcement Learning

Deep reinforcement learning aided secure UAV communications in the presence of moving eavesdroppers

Machine-Learning Beam Tracking and Weight Optimization for mmWave Multi-UAV Links

Fusing Channel and Sensor Measurements for Enhancing Predictive Beamforming in UAV-Assisted Massive MIMO Communications

KF-LSTM Based Beam Tracking for UAV-Assisted Mmwave HSR Wireless Networks.

Sensing-assisted Accurate and Fast Beam Management for Cellular-connected mmWave UAV Network

Deep Reinforcement Learning for Beam Management in UAV Relay mmWave Networks

Fully Decentralized Federated Learning Based Beamforming Design for UAV Communications

Environment-aware UAV Communications: CKM Construction and Predictive Beamforming

Deep Reinforcement Learning for Unmanned Aerial Vehicle-Assisted Vehicular Networks