Abstract:Integrating unmanned aerial vehicles(UAVs) with wireless systems is widely anticipated to bring enormous benefits to network users, and is considered as a key enabling technology for next generation wireless networks. However deployment of UAVs raises security concerns, as they are prone to eavesdropping attacks. In this paper we investigate secure data transmissions in a UAV-aided communication system from the physical layer security(PLS) perspective. The UAV is employed as a flying base station and transmit confidential information to a ground user. Specifically, an eavesdropper is moving in the vicinity of the ground user, attempting to intercept legitimate data transmission. We aim to optimize UAV trajectory to maximize secrecy throughput and due to the fast changing environment with unpredictable movements of the eave, this nonconvex problem is difficult to solve. Instead, we propose a deep reinforcement learning framework by reformulating this problem as a Markov Decision Process(MDP). By carefully designing state spaces,state-dependent action sets and time-dependant reward signals, we aim to help the agent learn an optimized trajectory and complete the flight task within time limit. We adapt the deep Q network(DQN) algorithm and extend it with prioritized experience replay(PER) and importance sampling method to ensure a stable and effective learning outcome. Simulation results validate the effectiveness of the learning algorithm and confirm that the agent is able to learn an effective policy with desirable and robust learning outcomes. Compared with benchmark schemes, our proposed scheme is shown to achieve considerable performance gain in secrecy throughput.

Deep Reinforcement Learning Enabled Covert Transmission with UAV

Deep Reinforcement Learning for UAV-Assisted Covert Data Dissemination.

Covert UAV Data Transmission Via Semantic Communication: A DRL-Driven Joint Position and Power Optimization Method

A deep reinforcement learning framework and its implementation for UAV-aided covert communication

Deep reinforcement learning aided secure UAV communications in the presence of moving eavesdroppers

Deep reinforcement learning for IRS-assisted UAV covert communications

A Learning Approach Towards Secure Cognitive Networks with UAV Relaying and Active Jamming

Matching combined multi-agent reinforcement learning for uav secure data dissemination

Deep Learning-Assisted Secure UAV-Relaying Networks with Channel Uncertainties

Multi-UAV Dynamic Wireless Networking with Deep Reinforcement Learning

Learning-Based Robust and Secure Transmission for Reconfigurable Intelligent Surface Aided Millimeter Wave UAV Communications

Towards Secrecy Energy-Efficient RIS Aided UAV Network: A Lyapunov-Guided Reinforcement Learning Approach

Deep Reinforcement Learning-Driven Reconfigurable Intelligent Surface-Assisted Radio Surveillance with a Fixed-Wing UAV.

UAV-Enabled Secure Communications by Multi-Agent Deep Reinforcement Learning

Deep Reinforcement Learning Based Trajectory Design and Resource Allocation for UAV-Assisted Communications

Deep Reinforcement Learning-Driven Jamming-Enhanced Secure Unmanned Aerial Vehicle Communications

Joint Beamforming and Trajectory Optimization for UAV-Assisted Double IRS Secure Transmission System: A Deep Reinforcement Learning Approach.

Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach

Enabling Urban MmWave Communications with UAV-Carried IRS Via Deep Reinforcement Learning

Deep Reinforcement Learning-based UAV Control for Optimized Energy Efficiency and Throughput in UAV-assisted Communication

When UAVs Meet Cognitive Radio: Offloading Traffic under Uncertain Spectrum Environment Via Deep Reinforcement Learning