Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

Function Recognition of Multi-function Radar Via CNN-GRU Neural Network

Multi-function radar work mode recognition based on encoder-decoder model

Multi‐function radar work mode recognition based on residual shrinkage reconstruction recurrent neural network

Recognition of Multifunction Radars Via Hierarchically Mining and Exploiting Pulse Group Patterns

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

Radar HRRP Target Recognition Method Based on Multi-Input Convolutional Gated Recurrent Unit With Cascaded Feature Fusion

Few-shot recognition of multi-function radar modes via Refined Prototypical Random Walk Network

LSTM-based Prediction of Multi-function Radar Work Mode

Multivariate Time Series Feature Extraction and Clustering Framework for Multi-Function Radar Work Mode Recognition

Radar HRRP Feature Fusion Recognition Method Based on ConvLSTM Network with Multi-Input Gate Recurrent Unit

Work Modes Recognition and Boundary Identification of MFR Pulse Sequences with a Hierarchical Seq2seq LSTM

Intra-pulse modulation recognition of radar signals based on multi-feature random matching fusion network

Robust Radar Work Mode Recognition in Non-Ideal Situations with GRU-TCN Model

Multilayer Decomposition Denoising Empowered CNN for Radar Signal Modulation Recognition

Radar HRRP Target Recognition Based on Deep Multi-Scale 1D Convolutional Neural Network

Specific Radar Recognition Based on Characteristics of Emitted Radio Waveforms Using Convolutional Neural Networks

Radar Operation Mode Recognition Via Multifeature Residual-and-Shrinkage ConvNet.

Operation Mode Recognition of Airborne Radar Based on Multi-Feature Fusion RS-ConvNet

Intra-pulse Modulation Radar Signal Recognition Based on CLDN Network

Radar Emitter Signal Recognition Based on One-Dimensional Convolutional Neural Network with Attention Mechanism

Self-Supervised Contrastive Learning for Extracting Radar Word in the Hierarchical Model of Multifunction Radar