Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

Deep Model Based Road User Classification Using Mm-Wave Radar

Point Cloud Features-Based Kernel SVM for Human-Vehicle Classification in Millimeter Wave Radar.

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

Road target recognition based on radar range-Doppler spectrum with GS – ResNet

Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors

Target detection and recognition of radar spectrum image based on deep learning

Automatic Target Recognition of Millimeter-Wave Radar Based on Deep Learning

Vehicle Classification Via Multi-dimension Feature Extraction with Millimeter Wave Radar

Radar Transformer: An Object Classification Network Based on 4D MMW Imaging Radar

Mmbehavior: Human Activity Recognition System of Millimeter-Wave Radar Point Clouds Based on Deep Recurrent Neural Network

Application of Deep Learning on Millimeter-Wave Radar Signals: A Review

Traffic Participants Classification Based on 3D Radio Detection and Ranging Point Clouds

Human Detection and Action Classification Based on Millimeter Wave Radar Point Cloud Imaging Technology

A New Automotive Radar 4D Point Clouds Detector by Using Deep Learning

A Combined mmWave Tracking and Classification Framework Using a Camera for Labeling and Supervised Learning

Object Detection of Millimeter Wave Radar Based on Computer Vision

A Target Recognition Algorithm Using Machine Learning Based on Millimeter Wave Radar on Intelligent Connected Vehicles

A New Pavement Recognition Method of 24-GHz Radar Based on Prior Knowledge and Data-Driven

Human Motion Classification Based On Range Information With Deep Convolutional Neural Network

A Target Detection Method of Automotive Millimeter Wave Radar Based on Deep Learning