Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

A Decision-level Weighting Fusion Detection Method Based on the Joint Multi-features of VFGPIR

Infrared and Radar Fusion Detection Method Based on Heterogeneous Data Preprocessing

A Novel Decision Fusion Scheme with Feedback in Neyman-Pearson Detection Systems.

A Novel Weighted Combination Strategy for Quasicoherent Fusion Using Multifrequency-Based Passive Bistatic Radar.

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

Applicability Analysis Of Cfar Algorithm For Landmines Detection Applied To Vehicle-Mounted Forward-Looking Sar

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

Interference State Estimation Based Weight Setting for Multichannel Joint Detection

Multi-Feature Fusion Based Outdoor Water Hazards Detection

Multi-parameters fusion algorithm for detecting anomalous water quality

Signal Fusion-based Detection with an Intuitive Weighting Method

A Novel Multifrequency GPR Data Fusion Algorithm Based on Time-Varying Weighting Strategy

A Novel Multi-Sensor Fusion Based Object Detection and Recognition Algorithm for Intelligent Assisted Driving

Multi-polarization Features Fusion Detection of Marine Small Targets based on LSTM

LPI Radar Waveform Recognition Based on Multi-Resolution Deep Feature Fusion

LPI Radar Waveform Recognition Based on Features from Multiple Images

Radar Signal Detection Method Based on Multi-Features Fusion

Research on Robust Detection System of Vehicle Attitude Fusion Features Based on Multi-Sensor Fusion

Multi-Objective Association Detection of Farmland Obstacles Based on Information Fusion of Millimeter Wave Radar and Camera

A large comparison of feature-based approaches for buried target classification in forward-looking ground-penetrating radar

A Novel Approach for Aerial Moving Target Fusion-Based Detection Method