Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

DNN-Based Peak Sequence Classification CFAR Detection Algorithm for High-Resolution FMCW Radar

Online Multipedestrian Tracking Based on Fused Detections of Millimeter Wave Radar and Vision

A Target Detection Scheme with Decreased Complexity and Enhanced Performance for Range-Doppler FMCW Radar.

A Novel CFAR Algorithm for Multi-target Detection with FMCW Radar

Radar Target Detection Based on OTFS Signaling: A Deep Learning Approach

Adaptive Multi-Pedestrian Tracking by Multi-Sensor: Track-to-Track Fusion Using Monocular 3D Detection and MMW Radar

Marine Navigation Radar Target Detection with Multi-scale Spatiotemporal Feature Fusion-based Deep Learning

Multiscale Feature Learning Based on Deep Pyramid Residual Shrinking Network for Radar Target Detection

A Feature-based Filtering Algorithm with 60ghz MIMO FMCW Radar for Indoor Detection and Trajectory Tracking

Target Detection in Clutter/Interference Regions Based on Deep Feature Fusion for HFSWR

Radar Point Clouds Processing for Human Activity Classification using Convolutional Multilinear Subspace Learning

Human Motion Recognition With Spatial-Temporal-ConvLSTM Network Using Dynamic Range-Doppler Frames Based on Portable FMCW Radar

Enhanced Detection of Doppler-Spread Targets for FMCW Radar

E 2 DTF: An End-to-End Detection and Tracking Framework for Multiple Micro-UAVs With FMCW-MIMO Radar

LPI Radar Waveform Recognition Based on Multi-Resolution Deep Feature Fusion

Enhanced Radar Signal Recognition Through Attention-Driven Multi-Domain Fusion Mechanism

Radar Signal Recognition Based on Transfer Learning and Feature Fusion

A Modified CA-CFAR Multi-human Detection Algorithm in Complex Environment Using Radar

A Method for Target Detection Based on Mmw Radar and Vision Fusion

Camera-Radar Fusion with Radar Channel Extension and Dual-CBAM-FPN for Object Detection