Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

Concealed Object Detection in Millimeter Wave Image Based on Global Correlation of Multi-level Features in Cross-section Sequence

Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image

Domain adaptive detection system for concealed objects using millimeter wave images

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

DNN-Based Peak Sequence Classification CFAR Detection Algorithm for High-Resolution FMCW Radar

Real-time dangerous objects detection in millimeter wave images

Suspicious Object Detection for Millimeter-Wave Images With Multi-View Fusion Siamese Network

Concealed Object Detection and Recognition System Based on Millimeter Wave FMCW Radar

Multi-Dimensional Information Fusion You Only Look Once Network for Suspicious Object Detection in Millimeter Wave Images

CNN with Pose Segmentation for Suspicious Object Detection in MMW Security Images

Real-Time Detection of Concealed Threats with Passive Millimeter Wave and Visible Images via Deep Neural Networks

Enhancing concealed object detection in Active Millimeter Wave Images using wavelet transform

Object recognition for millimeter wave SAR images based on dual-branch multi-scale fusion network

PointNet + + Based Concealed Object Classification Utilizing an FMCW Millimeter-Wave Radar

Concealed Object Detection for Millimeter-Wave Images With Normalized Accumulation Map

Concealed Object Detection for Passive Millimeter-Wave Security Imaging Based on Task-Aligned Detection Transformer

LEC-MTNN: a Novel Multi-Frame Infrared Small Target Detection Method Based on Spatial-Temporal Patch-Tensor

High-Performance Detection of Concealed Forbidden Objects on Human Body with Deep Neural Networks Based on Passive Millimeter Wave and Visible Imagery

Active and passive mixed millimeter wave imaging target recognition method based on multi‐feature fusion

A Suspicious Multi-Object Detection and Recognition Method for Millimeter Wave SAR Security Inspection Images Based on Multi-Path Extraction Network

MMW-Carry: Enhancing Carry Object Detection through Millimeter-Wave Radar-Camera Fusion