Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

Implementation of Manhole Cover Detection System Based on Multi Feature Fusion

Hazards Detection Multi-Feature Fusion Based Outdoor Water

Daytime Water Hazard Detection Based on Multi-Feature Fusion

Multi-Feature Fusion Based Outdoor Water Hazards Detection

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

A Decision-level Weighting Fusion Detection Method Based on the Joint Multi-features of VFGPIR

Real-time detection of road manhole covers with a deep learning model

Moving Object Recognition Based on Multi-feature Fusion

Transmission Line Obstacle Detection Based on Structural Constraint and Feature Fusion

A Surface Defect Detection Method Based on Multi-Feature Fusion

Efficient Approach to Automated Pavement Manhole Detection with Modified Faster R-CNN

Tire Defect Detection Based on Low and High-level Feature Fusion

Design and Implementation of Manhole Cover Safety Monitoring System based on Smart Light Pole

Automatic defect detection of metro tunnel surfaces using a vision-based inspection system

Deep multi-scale and multi-modal fusion for 3D object detection

Multi-scale object detection for high-speed railway clearance intrusion

An End-to-End Steel Surface Defect Detection Approach via Fusing Multiple Hierarchical Features

DSFFNet: Tire Defect Detection Based on Deep and Shallow Feature Fusion

3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images

A Novel Lane Line Detection Based on Multi-feature Fusion and Windows Searching

A Novel Day-to-Night Obstacle Detection Method for Excavators Based on Image Enhancement and Multisensor Fusion