Abstract:This paper studies an integrated sensing and communications (ISAC) system for low-altitude economy (LAE), where a ground base station (GBS) provides communication and navigation services for authorized unmanned aerial vehicles (UAVs), while sensing the low-altitude airspace to monitor the unauthorized mobile target. The expected communication sum-rate over a given flight period is maximized by jointly optimizing the beamforming at the GBS and UAVs' trajectories, subject to the constraints on the average signal-to-noise ratio requirement for sensing, the flight mission and collision avoidance of UAVs, as well as the maximum transmit power at the GBS. Typically, this is a sequential decision-making problem with the given flight mission. Thus, we transform it to a specific Markov decision process (MDP) model called episode task. Based on this modeling, we propose a novel LAE-oriented ISAC scheme, referred to as Deep LAE-ISAC (DeepLSC), by leveraging the deep reinforcement learning (DRL) technique. In DeepLSC, a reward function and a new action selection policy termed constrained noise-exploration policy are judiciously designed to fulfill various constraints. To enable efficient learning in episode tasks, we develop a hierarchical experience replay mechanism, where the gist is to employ all experiences generated within each episode to jointly train the neural network. Besides, to enhance the convergence speed of DeepLSC, a symmetric experience augmentation mechanism, which simultaneously permutes the indexes of all variables to enrich available experience sets, is proposed. Simulation results demonstrate that compared with benchmarks, DeepLSC yields a higher sum-rate while meeting the preset constraints, achieves faster convergence, and is more robust against different settings.

Securing Integrated Sensing and Communication Against a Mobile Adversary: A Stackelberg Game with Deep Reinforcement Learning

UAV-assisted ISAC network physical layer security based on Stackelberg game

Cooperative Secure Communication in UAV Assisted Networks with Dynamic Role Switching.

Anti-Jamming Resource Allocation for Integrated Sensing and Communications Based on Game-Guided Reinforcement Learning

A Learning Approach Towards Secure Cognitive Networks with UAV Relaying and Active Jamming

An Adaptive Trust-Stackelberg Game Model for Security and Energy Efficiency in Dynamic Cognitive Radio Networks.

UAV Communication Against Intelligent Jamming: A Stackelberg Game Approach With Federated Reinforcement Learning

Dynamic Role Switching Scheme with Joint Trajectory and Power Control for Multi-UAV Cooperative Secure Communication

Secure Cognitive Communication Via Cooperative Jamming

A Two-Stage Game Framework to Secure Transmission in Two-Tier UAV Networks.

A Proactive Eavesdropping Game in MIMO Systems Based on Multiagent Deep Reinforcement Learning

A Robust Stackelberg Game for Cyber-Security Investment in Networked Control Systems

Secure transmission in satellite-UAV integrated system against eavesdropping and jamming: A two-level stackelberg game model

Integrated Sensing and Communications for Low-Altitude Economy: A Deep Reinforcement Learning Approach

Deep Reinforcement Learning-Driven Jamming-Enhanced Secure Unmanned Aerial Vehicle Communications

Anti-jamming for Cognitive Radio Networks with Stackelberg Game-Assisted DSSS Approach

Securing Wireless Transmission Against Reactive Jamming: A Stackelberg Game Framework

Anti-Intelligent UAV Jamming Strategy Via Deep Q-Networks

Smart Shield: Prevent Aerial Eavesdropping Via Cooperative Intelligent Jamming Based on Multi-Agent Reinforcement Learning

TSGS: Two-stage security game solution based on deep reinforcement learning for Internet of Things

Optimal Proactive Eavesdropping Scheme Based on Stackelberg Game Framework Against State-Secrecy Encoding: A Deep Reinforcement Learning Approach