Abstract:We track moving targets with a distributed multiple-input multiple-output (MIMO) radar, for which the transmitters and receivers are appropriately paired and selected with a limited number of radar stations. We aim to maximize the sum of the signal-to-interference-plus-noise ratios (SINRs) of all the targets by sensibly selecting the transmitter-receiver pairs during the tracking period. A key is to model the optimization problem of selecting the transmitter-receiver pairs by a restless multi-armed bandit (RMAB) model that is able to formulate the time-varying signals of the transceiver channels whenever the channels are being probed or not. We regard the estimated mean reward (i.e., SINR) as the state of an arm. If an arm is probed, the estimated mean reward of the arm is the weighted sum of the observed reward and the predicted mean reward; otherwise, it is the predicted mean reward. We associate the predicted mean reward with the estimated mean reward at the previous time slot and the state of the target, which is estimated via the interacting multiple model-unscented Kalman filter (IMM-UKF). The optimized selection of transmitter-receiver pairs at each time is accomplished by using Binary Particle Swarm Optimization (BPSO) based on indexes of arms, each of which is designed by the upper confidence bound (UCB1) algorithm. Above all, a multi-group combinatorial-restless-bandit technique taking into account of different combinations of transmitters and receivers and the closed-loop scheme between transmitter-receiver pair selection and target state estimation, namely MG-CRB-CL, is developed to achieve a near-optimal selection strategy and improve multi-target tracking performance. Simulation results for different scenarios are provided to verify the effectiveness and superior performance of our MG-CRB-CL algorithm.

Weak Target Detection in Massive MIMO Radar via an Improved Reinforcement Learning Approach

Reinforcement learning-based waveform optimization for MIMO multi-target detection

A multi-channel based passive detection strategy for high-speed moving target in the airspace under varying interference.

Deep Reinforcement Learning Based on Location-Aware Imitation Environment for RIS-Aided Mmwave MIMO Systems

POMDP-Driven Cognitive Massive MIMO Radar: Joint Target Detection-Tracking In Unknown Disturbances

A new method of improving the weak target detection performance based on the MIMO radar

Combinatorial-restless-bandit-based Transmitter-Receiver Online Selection for Distributed MIMO Radars With Non-Stationary Channels

Massive MIMO Radar for Target Detection

Transmit Antenna Selection and Power Allocation for Joint Multi-Target Localization and Discrimination in MIMO Radar with Distributed Antennas under Deception Jamming

Multi-Target Detection and Adaptive Waveform Design for Cognitive MIMO Radar

Self-attention reinforcement learning for multi-beam combining in mmWave 3D-MIMO systems

A Cognitive Multi-Carrier Radar for Communication Interference Avoidance Via Deep Reinforcement Learning

Intelligent Passive Eavesdropping in Massive MIMO-OFDM Systems via Reinforcement Learning

Learning to Select for MIMO Radar based on Hybrid Analog-Digital Beamforming

Suboptimum Low Complexity Joint Multi-target Detection and Localization for Noncoherent MIMO Radar with Widely Separated Antennas

Deep Reinforcement Learning for Multi-user Massive MIMO with Channel Aging

Deep Reinforcement Learning Control for Radar Detection and Tracking in Congested Spectral Environments

Reinforcement Learning for Beam Pattern Design in Millimeter Wave and Massive MIMO Systems

Joint Detection and Delay-Doppler Estimation Algorithms for MIMO Radars

Optimizations of Multisite Radar System with MIMO Radars for Target Detection.