Adaptive Radar Resource Management for All-Digital Multi-Function Phased Array Radar Using Proximal Policy Optimization

Tian-You Yu,Geoffrey Dolinger,Brianna Witherell,Alexander Stringer,D. Schvartzman,Nathan Goodman
DOI: https://doi.org/10.1109/RadarConf2458775.2024.10548047
2024-05-06
Abstract:This paper presents a novel approach to radar resource management (RRM) for multi-function phased array radars (MFR), specifically focusing on all-digital architecture with enhanced capabilities such as dynamic subarray allocation and adaptive digital beamforming. The core contribution of this paper lies in the application of the multi-agent proximal policy optimization (MAPPO) reinforcement learning algorithm to RRM, a significant shift from existing adaptive RRM strategies that predominantly employ deep Q-networks. The MAPPO algorithm's ability to balance exploration and exploitation, along with its stability and efficiency, makes it an ideal solution for the resource-constrained, real-time demands of RRM in all-digital MFRs. The algorithm is rigorously trained in simulations using realistic target motion models and is tested in scenarios involving single and multiple beams, taking advantage of the flexibility offered by all-digital MFRs. Results demonstrate the algorithm's capability to effectively search for targets, maintain target tracks in overloaded conditions, and cooperatively allocate tasks.
Computer Science,Engineering
What problem does this paper attempt to address?