Abstract:Unmanned aerial vehicles (UAVs) have played an increasingly important role in military operations and social life. Among all application scenarios, multi-target tracking tasks accomplished by UAV swarms have received extensive attention. However, when UAVs use radar to track targets, the tracking performance can be severely compromised by jammers. To track targets in the presence of jammers, UAVs can use passive radar to position the jammer. This paper proposes a system where a UAV swarm selects the radar's active or passive work mode to track multiple differently located and potentially jammer-carrying targets. After presenting the optimization problem and proving its solving difficulty, we use a multi-agent reinforcement learning algorithm to solve this control problem. We also propose a mechanism based on simulated annealing algorithm to avoid cases where UAV actions violate constraints. Simulation experiments demonstrate the effectiveness of the proposed algorithm.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to avoid the degradation of tracking performance when using radar for multi - target tracking by multiple Unmanned Aerial Vehicles (UAVs) in the presence of jammers. Specifically: 1. **Problem Background**: - UAVs are playing an increasingly important role in military operations and social life. - In all application scenarios, especially in military applications, when UAVs use radar for multi - target tracking, the tracking performance may be severely affected by malicious jammers. - Current research has not fully considered how to avoid the degradation of UAV tracking performance in the presence of jammers. 2. **Specific Problems**: - When UAVs use radar to track targets, jammers will severely degrade the tracking performance. - To solve this problem, UAVs can use passive radar to locate jammers, but there is a contradiction between passive reception and active transmission. - A method is needed for the UAV group to select the working mode of the radar (active mode or passive mode) in the presence of jammers, so as to effectively track multiple targets at different locations. 3. **Solutions**: - The paper proposes an algorithm based on Multi - Agent Reinforcement Learning (MARL) to solve this control problem. - At the same time, a mechanism based on the Simulated Annealing (SA) algorithm is proposed to prevent UAVs' behaviors from violating constraint conditions, thereby ensuring that the tracking performance is not affected. 4. **Optimization Problems**: - The author defines an optimization problem and proves the difficulty of directly solving this problem. - Use the multi - agent reinforcement learning algorithm to solve this optimization problem, and introduce the simulated annealing algorithm to handle the constraint conditions. 5. **Verification and Results**: - The effectiveness of the proposed algorithm is verified through simulation experiments, and the results show that the algorithm can significantly improve the performance of multi - target tracking in the presence of jammers. In summary, this paper aims to solve the challenges faced by UAV groups in multi - target tracking in the presence of jammers, and proposes solutions based on multi - agent reinforcement learning and simulated annealing algorithms to improve tracking performance and ensure that behaviors comply with constraint conditions.

A MARL Based Multi-Target Tracking Algorithm Under Jamming Against Radar

Multi-Agent Reinforcement Learning Based UAV Swarm Communications Against Jamming

Dynamic UAV Swarm Collaboration for Multi-Targets Tracking under Malicious Jamming: Joint Power, Path and Target Association Optimization

Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems

Multi-Agent Reinforcement Learning Aided Intelligent UAV Swarm for Target Tracking

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

A Collaborative Jamming Algorithm Based on Multi-UAV Scheduling

Integrated Design of Cooperative Area Coverage and Target Tracking with Multi-UAV System

An Optimization Method for Collaborative Radar Antijamming Based on Multi-Agent Reinforcement Learning

Joint Trajectory Planning and Transmit Resource Optimization for Multi-Target Tracking in Multi-UAV-Enabled MIMO Radar System

Multi-UAV Cooperative Target Tracking Based on Swarm Intelligence

Joint Antenna Scheduling and Power Allocation for Multi-Target Tracking under Range Deception Jamming in Distributed MIMO Radar System

Joint Optimization of Jamming Type Selection and Power Control for Countering Multi-function Radar Based on Deep Reinforcement Learning

Joint Optimization of Trajectory and Jamming Power for Multiple UAV-aided Proactive Eavesdropping

Cooperative Simultaneous Tracking and Jamming for Disabling a Rogue Drone

Multi-Agent System for Rogue Drone Interception

A Distributed MIMO Radar Oriented Barrage Jamming Strategy

Energy Efficient Design in IRS-Assisted UAV Data Collection System under Malicious Jamming

Multi-UAV cooperative reconnaissance mission planning novel method under multi-radar detection

A Multiple-Jammer Deceptive Jamming Method Based on Particle Swarm Optimization Against Three-Channel SAR GMTI

Approximating Nash equilibrium for anti-UAV jamming Markov game using a novel event-triggered multi-agent reinforcement learning