Abstract:This paper considers a joint communication and sensing technique for enhancing situational awareness in practical battlefield scenarios. In particular, we propose an aerial reconfigurable intelligent surface (ARIS)-assisted integrated sensing and communication (ISAC) system consisting of a single access point (AP), an ARIS, multiple users, and a sensing target. With deep reinforcement learning (DRL), we jointly optimize the transmit beamforming of the AP, the RIS phase shifts, and the trajectory of the ARIS under signal-to-interference-noise ratio (SINR) constraints. Numerical results demonstrate that the proposed technique outperforms the conventional benchmark schemes by suppressing the self-interference and clutter echo signals or optimizing the RIS phase shifts.

What problem does this paper attempt to address?

The paper attempts to address the issue of enhancing situational awareness in actual battlefield environments. Specifically, the authors propose an Integrated Sensing and Communication (ISAC) system based on Airborne Reconfigurable Intelligent Surface (ARIS), aiming to improve target detection and communication performance on the battlefield through joint optimization of transmission beamforming, RIS phase shifts, and ARIS trajectory. ### Main Issues 1. **Physical Limitations**: Due to the complexity of the battlefield environment, there are various obstacles (such as mountains) that obstruct the Line-of-Sight (LoS) link, leading to severe signal attenuation as the communication distance increases. 2. **Self-Interference and Clutter Echo Signals**: Full-duplex Access Points (APs) are affected by self-interference when receiving sensing echoes and need to suppress echo signals from clutter. 3. **Non-convexity of the Optimization Problem**: Joint optimization of transmission beamforming, RIS phase shifts, and ARIS trajectory is a non-convex problem, making it difficult for traditional optimization methods to be quickly applied in dynamic battlefield environments. ### Solutions 1. **ARIS-assisted ISAC System**: Utilize the mobility of ARIS to create virtual LoS links, extending the range of target detection and communication. 2. **Deep Reinforcement Learning (DRL)**: Employ the Deep Deterministic Policy Gradient (DDPG) algorithm to search for the optimal strategy through interaction with the environment, achieving joint optimization of transmission beamforming, RIS phase shifts, and ARIS trajectory. 3. **Null Space Projection (NSP) Receive Beamforming**: Design an NSP method to effectively suppress self-interference and clutter echo signals, improving sensing performance. ### Experimental Results - **Performance Improvement**: Simulation results show that the proposed ARIS-assisted ISAC system significantly outperforms traditional benchmark schemes in terms of target localization accuracy and communication quality. - **Fast Convergence**: Through the DRL method, the system can find the optimal solution in a short time, quickly adapting to changes in the battlefield environment. ### Conclusion The paper proposes an innovative ARIS-assisted ISAC system that significantly improves target detection and communication performance on the battlefield through joint optimization of transmission beamforming, RIS phase shifts, and ARIS trajectory. Experimental results validate the effectiveness and superiority of this approach.

Enhancing Battlefield Awareness: An Aerial RIS-assisted ISAC System with Deep Reinforcement Learning

Reconfigurable Intelligent Surface-Assisted Aerial-Terrestrial Communications Via Multi-Task Learning

Reconfigurable Intelligent Surface Assisted Integrated Sensing, Communication and Computation Systems

Intelligent Spectrum Learning for Wireless Networks with Reconfigurable Intelligent Surfaces.

Penalized Reinforcement Learning-Based Energy-Efficient UAV-RIS Assisted Maritime Uplink Communications Against Jamming

A Deep Reinforcement Learning Approach for Autonomous Reconfigurable Intelligent Surfaces

Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces

Joint Design of Transmit Waveform and Passive Beamforming for RIS-assisted ISAC System

Deep Reinforcement Learning for Multi-Functional RIS-Aided Over-the-Air Federated Learning in Internet of Robotic Things

Deep Learning for Secure Transmission in Reconfigurable Intelligent Surface-Assisted Communications.

A Robust Deep Learning-Based Beamforming Design for RIS-Assisted Multiuser MISO Communications with Practical Constraints

Joint Task Offloading and Resource Allocation for Intelligent Reflecting Surface-Aided Integrated Sensing and Communication Systems Using Deep Reinforcement Learning Algorithm

Bayesian Learning for Double-RIS Aided ISAC Systems with Superimposed Pilots and Data

Deep Reinforcement Learning based Downlink Beamforming and Phase Optimization for RIS-Aided Communication System

Deep Reinforcement Learning-Driven Reconfigurable Intelligent Surface-Assisted Radio Surveillance with a Fixed-Wing UAV.

RIS-Aided Integrated Sensing and Communication: Joint Beamforming and Reflection Design

Integrated Sensing and Communication with Reconfigurable Distributed Antenna and Reflecting Surface: Joint Beamforming and Mode Selection

Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning

Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems

Low Dynamic Range for RIS-aided Bistatic Integrated Sensing and Communication

Joint Active and Passive Beamforming in RIS-Assisted Secure ISAC Systems