Abstract:Radar-based gait recognition has gained wide attention recently for its ability to preserve privacy and adapt to low-light and poor-weather scenarios. Among different forms of input data, a radar point cloud is an appealing option as it captures not only the appearance signatures but also the motion signatures of the subject. For gait recognition, both appearance and motion are crucial signatures that can be represented by spatial features and temporal features, respectively. However, the spatial-temporal features extracted by existing radar point cloud-based methods are coarse-grained, leading to poor performance in realistic applications. To enhance the spatial-temporal feature representation ability of the radar point cloud-based method, in this article, we design a novel network to extract fine-grained spatial-temporal gait features from a millimeter-wave (mmWave) radar point cloud. For fine-grained spatial feature extraction, we apply a dual-stream feature extraction (DSFE) module to exploit the 3-D coordinates, intensity, and velocity information within the radar point cloud. After that, since each body part has its unique characteristics in the gait task, we also propose a probability-guided body-part partition (PGBP) module to split the radar point cloud into fine-grained spatial body parts. For fine-grained temporal feature extraction, a local-global temporal feature extraction (LGTE) module is used to further capture the temporal patterns of each body part. To evaluate the effectiveness of the proposed methods, we conduct extensive experiments with 90 subjects in various realistic settings, i.e., cross-view and cross-wearing conditions. The results demonstrate that our model achieves significant improvement over existing radar-based gait recognition methods.

Human Body and Limb Motion Recognition Via Stacked Gated Recurrent Units Network

Human Motion Recognition Exploiting Radar with Stacked Recurrent Neural Network

A RD-T Network for Hand Gesture Recognition Based on Millimeter-Wave Sensor

Human Motion Recognition With Spatial-Temporal-ConvLSTM Network Using Dynamic Range-Doppler Frames Based on Portable FMCW Radar

Fine-Grained Spatial–Temporal Gait Recognition Network Based on Millimeter-Wave Radar Point Cloud

RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

Segmented Convolutional Gated Recurrent Neural Networks for Human Activity Recognition in Ultra-Wideband Radar.

Human gait recognition using micro-doppler features

Hand Trajectory Recognition by Radar with a Finite-State Machine and a Bi-LSTM

Millimeter-Wave Array Radar-Based Human Gait Recognition Using Multi-Channel Three-Dimensional Convolutional Neural Network

Radar-Based Human Motion Recognition Using Semisupervised Triple-GAN

Multi-View Real-Time Human Motion Recognition Based on Ensemble Learning

Continuous Arm Motion Recognition Using Two-stream Spatial-Temporal Neural Network Based on Millimeter Wave Sensor

Stacked LSTM-Based Dynamic Hand Gesture Recognition with Six-Axis Motion Sensors

Deep Stacked Bidirectional Lstm Neural Network For Skeleton-Based Action Recognition

Human motion prediction with gated recurrent unit model of multi-dimensional input

A Robust Real-time Human Activity Recognition Method Based on Attention-Augmented GRU

BiGRU Network for Human Activity Recognition in High Resolution Range Profile

Radar-Based Human Gait Recognition Using Dual-Channel Deep Convolutional Neural Network

Two-Stream Time Sequential Network Based Hand Gesture Recognition Method Using Radar Sensor

Stpointgcn: Spatial Temporal Graph Convolutional Network for Multiple People Recognition Using Millimeter-Wave Radar