Abstract:Integrating unmanned aerial vehicles(UAVs) with wireless systems is widely anticipated to bring enormous benefits to network users, and is considered as a key enabling technology for next generation wireless networks. However deployment of UAVs raises security concerns, as they are prone to eavesdropping attacks. In this paper we investigate secure data transmissions in a UAV-aided communication system from the physical layer security(PLS) perspective. The UAV is employed as a flying base station and transmit confidential information to a ground user. Specifically, an eavesdropper is moving in the vicinity of the ground user, attempting to intercept legitimate data transmission. We aim to optimize UAV trajectory to maximize secrecy throughput and due to the fast changing environment with unpredictable movements of the eave, this nonconvex problem is difficult to solve. Instead, we propose a deep reinforcement learning framework by reformulating this problem as a Markov Decision Process(MDP). By carefully designing state spaces,state-dependent action sets and time-dependant reward signals, we aim to help the agent learn an optimized trajectory and complete the flight task within time limit. We adapt the deep Q network(DQN) algorithm and extend it with prioritized experience replay(PER) and importance sampling method to ensure a stable and effective learning outcome. Simulation results validate the effectiveness of the learning algorithm and confirm that the agent is able to learn an effective policy with desirable and robust learning outcomes. Compared with benchmark schemes, our proposed scheme is shown to achieve considerable performance gain in secrecy throughput.

Secure Data Transmission Based On Reinforcement Learning and Position Confusion for Internet of UAVs

A Two-Stage Game Framework to Secure Transmission in Two-Tier UAV Networks.

Deep reinforcement learning aided secure UAV communications in the presence of moving eavesdroppers

Covert UAV Data Transmission Via Semantic Communication: A DRL-Driven Joint Position and Power Optimization Method

Secure Intelligent Reflecting Surface Assisted UAV Communication Networks.

Improving Physical Layer Security for Multi-Uav Systems Against Hybrid Wireless Attacks

Energy-efficient and Secure Communication towards UAVs Networks

Learning-Based Robust and Secure Transmission for Reconfigurable Intelligent Surface Aided Millimeter Wave UAV Communications

A Secure Communication Framework for Large-Scale Unmanned Aircraft Systems

Robust Secure UAV Communications with the Aid of Reconfigurable Intelligent Surfaces

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

Multi-Agent Deep Reinforcement Learning for Secure UAV Communications

DDPG-based Aerial Secure Data Collection

Deep Reinforcement Learning-Driven Reconfigurable Intelligent Surface-Assisted Radio Surveillance with a Fixed-Wing UAV.

Leveraging UAV-RIS Reflects to Improve the Security Performance of Wireless Network Systems

Joint Beamforming and Trajectory Optimization for UAV-Assisted Double IRS Secure Transmission System: A Deep Reinforcement Learning Approach.

Secure URLLC Empowered by UAV in 6G: an Interference Engineering Perspective

UAV-Enabled Secure Communications by Multi-Agent Deep Reinforcement Learning

RIS-assisted UAV Communications for IoT with Wireless Power Transfer Using Deep Reinforcement Learning

Multi-UAV-assisted covert communications for secure content delivery in Internet of Things

Reconfigurable Intelligent Surface Aided Secure UAV Communications