Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

Radar-Based Multiple Target Classification in Complex Environments Using 1D-CNN Models

Radar2: Passive Spy Radar Detection and Localization Using COTS Mmwave Radar

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

DNN-Based Peak Sequence Classification CFAR Detection Algorithm for High-Resolution FMCW Radar

One Size Does Not Fit All: Multi-Scale, Cascaded RNNs for Radar Classification

Multi-target tracking and activity classification with millimeter-wave radar

Radar Signal Classification with Multi-Frequency Multi-Scale Deformable Convolutional Networks and Attention Mechanisms

RadarTCN: Lightweight Online Classification Network for Automotive Radar Targets Based on TCN

Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors

Radar Target Detection Based on OTFS Signaling: A Deep Learning Approach

Classification-Aided Robust Multiple Target Tracking Using Neural Enhanced Message Passing

Real-Time Ubiquitous Radar Target Classification with 1D ResNet-SE-Based Multi-Channel Network

Real-time People Tracking and Identification from Sparse mm-Wave Radar Point-clouds

Automatic Target Recognition Method for Low-Resolution Ground Surveillance Radar Based on 1D-CNN

Deep Learning-based Estimation for Multitarget Radar Detection

3D Detection and Tracking for On-road Vehicles with a Monovision Camera and Dual Low-cost 4D mmWave Radars

A Combined mmWave Tracking and Classification Framework Using a Camera for Labeling and Supervised Learning

Deep MIMO Radar Target Detector in Gaussian Clutter

Analysis of data-driven approaches for radar target classification

Concealed Object Detection and Recognition System Based on Millimeter Wave FMCW Radar