Abstract:Human movement detection based on millimeter-wave radar sensors is a technology of interest in various areas such as for smart surveillance, security, behavioral biometrics, biomedical systems, robotics, etc. This paper shows the feasibility and effectiveness of using a compact 24 GHz Doppler radar with a built-in low-noise microwave amplifier (LNA) for detecting and extracting signals coming from human motion. Reliability and accuracy is assessed based on a comprehensive theoretical analysis, and on simulation results followed by experimental investigations. A continuous wavelet transform (CWT) is used to decompose in-phase and quadrature (${I/Q}$ ) baseband signals to extract information about the dynamics of the system. The dataset consists of 1000 recordings in 8 motion classes (standing, walking, sitting, etc.). We propose to apply a two-channel convolutional neural network (CNN), which is composed of two CNN channels, for learning high-level features from time-domain signals and CWT spectrograms. One channel has four one-dimensional (1D) convolutional and pooling layers, and the other channel is made of three two-dimensional (2D) convolutional and pooling layers. In addition, the ${I/Q}$ signals are denoised by using Savitzky-Golay filtering, and both noisy and denoised signals are used as input signals for deep learning data augmentation purpose. We achieved an overall classification accuracy rate of 98.85% in motion classification for a two-branch CNN architecture, and an accuracy rate of 95.3% for a one-branch 2D-CNN. Our results show that a dual-channel CNN model can greatly increase the classification capabilities of human motion recognition and classification, and the proposed method can be effectively used with various radar signal classifications.

Human Motion Recognition Exploiting Radar with Stacked Recurrent Neural Network

Human Body and Limb Motion Recognition Via Stacked Gated Recurrent Units Network

Human Motion Recognition With Spatial-Temporal-ConvLSTM Network Using Dynamic Range-Doppler Frames Based on Portable FMCW Radar

Residual Neural Network Driven Human Activity Recognition by Exploiting FMCW Radar

Learning to Track Multiple Radar Targets with Long Short-Term Memory Networks

Radar HRRP Target Recognition Model Based on a Stacked CNN–Bi-RNN With Attention Mechanism

Parallel LSTM-CNN Network with Radar Multispectrogram for Human Activity Recognition

Deeply-Fused Human Motion Recognition Network in Radar for In-Home Monitoring

A Convolutional Neural Network for Human Motion Recognition and Classification Using a Millimeter-Wave Doppler Radar

Human Motion Recognition Based on Radar Micro-Doppler Features Using Bayesian Network

LSTM based Human Activity Classification on Radar Range Profile

Mmbehavior: Human Activity Recognition System of Millimeter-Wave Radar Point Clouds Based on Deep Recurrent Neural Network

Human Behavior Recognition Using Micro-Doppler Signatures and 2D-CNN-LSTM Network

Segmented Convolutional Gated Recurrent Neural Networks for Human Activity Recognition in Ultra-Wideband Radar.

Continuous Arm Motion Recognition Using Two-stream Spatial-Temporal Neural Network Based on Millimeter Wave Sensor

SRCNN: Stacked-Residual Convolutional Neural Network for Improving Human Activity Classification Based on Micro-Doppler Signatures of FMCW Radar

Attention-based Stacked Bidirectional LSTM Networks for Radar Working Mode Recognition

Human Motion Recognition by Micro-Doppler Features and Concatenated CNN-LSTM Network

Radar Human Activity Recognition with an Attention-Based Deep Learning Network

Person Identification with Limited Training Data Using Radar Micro‐doppler Signatures

Multi-View Real-Time Human Motion Recognition Based on Ensemble Learning