Abstract:Deep learning (DL) frameworks are widely used in various applications due to their superiority over conventional handcrafted feature-based algorithms. However, applying DL to time-range feature map-based people flow detection (PFD) with frequency-modulated continuous wave (FMCW) radar still faces several challenges: 1) simultaneously achieving people counting and motion direction recognition requires a unified framework; 2) existing mainstream network backbones designed for semantic information-rich optical images or natural language suffer performance loss in time-range feature maps with weak semantic information; and 3) the construction of labeled datasets in PFD scenes is usually costly, and limited data lead to performance loss due to overfitting. Therefore, this article proposes novel solutions from various aspects to efficiently apply DL to time-range feature map-based PFD. First, new preprocessing pipelines with Doppler spectrum analysis-based feature map truncation (DSAFMT) are proposed for the first time to simultaneously achieve people counting and direction recognition using a single radar in the radar PFD field. Second, a novel lightweight multiscale feature space fusion-based convolutional neural network backbone (MFSNet) is designed to efficiently extract multichannel differentiated representative features from time-range feature maps. Finally, a multiencoder-classifier cotraining architecture based on embedded features with two data synthesis methods and a newly designed loss function is proposed to improve the generalization ability of the algorithm. Using the test dataset collected from real scenes, the performance comparison results show that the proposed PFD algorithm outperforms the state-of-the-art algorithms and ablation studies demonstrate the effectiveness of each component of the proposed algorithm in PFD.

A New Deep Learning Framework for HF Signal Detection in Wideband Spectrogram

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

DNN-Based Peak Sequence Classification CFAR Detection Algorithm for High-Resolution FMCW Radar

Automatic Radar Signal Detection and FFT Estimation using Deep Learning

Radar Target Detection Based on OTFS Signaling: A Deep Learning Approach

Large Scale Radio Frequency Wideband Signal Detection & Recognition

A Deep Learning Framework for Signal Detection and Modulation Classification

Deep Learning Classification of 3.5 GHz Band Spectrograms with Applications to Spectrum Sensing

Deep Learning Aided Time-Frequency Analysis Filter Framework for Suppressing Ionosphere Clutter

A deep-learning based high-gain method for underwater acoustic signal detection in intensity fluctuation environments

Deep learning-based framework for expansion, recognition and classification of underwater acoustic signal

A start-stop points CenterNet for wideband signals detection and time-frequency localization in spectrum sensing

Detection Algorithm of Frequency Hopping Signals Based on S Transform and Deep Learning

Deep Learning for Spectrum Sensing.

Detection of Frequency-Hopping Signals With Deep Learning

Spectro-Temporal RF Identification using Deep Learning

Data Classification and Parameter Estimations with Deep Learning to the Simulated Time-domain High-frequency Gravitational Waves Detections

Wide and Deep Fourier Neural Network for Hyperspectral Remote Sensing Image Classification

Deep Learning Based Detection for Spectrally Efficient FDM Systems

A Robust Deep Learning Framework Based on Spectrograms for Heart Sound Classification

A Multiantenna Spectrum Sensing Method Based on HFDE‐CNN‐GRU under Non‐Gaussian Noise