Abstract:Radar is widely used in human activity recognition (HAR). The radar-based HAR algorithms can be roughly categorized into feature map-based and point cloud-based. Between the two, the point cloud-based algorithms are more suitable for multiperson activity recognition (MPAR) tasks due to the spatial properties of point clouds and are therefore increasingly attracting attention. However, most existing point cloud-based algorithms make decisions by utilizing either Doppler or coordinate features of point clouds, which are not sufficient to characterize the activity; the remaining algorithms have large randomness in extracting both features. Neither of these algorithms can fully exploit the advantage of feature fusion, which is the key to recognition performance. To address this shortcoming, this article proposes a novel MPAR algorithm. First, a feature mapping approach is proposed and defined in equation form, the Doppler, range, azimuth, and elevation features of the point clouds are calculated and accumulated sequentially, so we can obtain the four time-domain feature maps. Second, with the four feature maps as inputs, a four-channel convolutional neural network (CNN) classification model with channel attention is trained for MPAR tasks. Datasets of multi-person activities are collected respectively under indoor circumstances and aquatic circumstances using the millimeter-wave multiple-input–multiple-output (MIMO) radar platform. The dataset-based evaluation performance shows that the proposed algorithm achieves accuracy results of 96.09% for the indoor-MPAR task and 93.97% for the aquatic-MPAR task, and outperforms three conventional point cloud-based algorithms in terms of the overall MPAR accuracy, the generalization ability to the aquatic activity recognition, and the robustness of distance and headcount.

A Deep Multi-task Network for Activity Classification and Person Identification with Micro-Doppler Signatures

A Novel Multiperson Activity Recognition Algorithm Based on Point Clouds Measured by Millimeter-Wave MIMO Radar

A Mutiscale Residual Attention Network for Multitask Learning of Human Activity Using Radar Micro-Doppler Signatures

A Novel Real-Time Multi-Person Activity Recognition System Using Millimeter-Wave SISO Radar Data

Deep Learning based Human Activity Classification in Radar Micro-Doppler Image

Person Identification with Limited Training Data Using Radar Micro‐doppler Signatures

Person Identification with Low Training Sample Based on Micro-Doppler Signatures Separation

Mmbehavior: Human Activity Recognition System of Millimeter-Wave Radar Point Clouds Based on Deep Recurrent Neural Network

Human Activity And Identitymulti-Task Recognition Based On Convolutional Neural Network Using Doppler Radar

Human Identification Based on Radar Micro‐doppler Signatures Separation

Person Identification Based on Fine-Grained Micro-Doppler Signatures and UWB Radar

LSTM based Human Activity Classification on Radar Range Profile

Human Activity Classification Based on Dual Micro-Motion Signatures Using Interferometric Radar

Person Identification Using Micro-Doppler Signatures of Human Motions and UWB Radar

Person Identification Using a New CNN-based Method and Radar Gait Micro-Doppler Signatures

Human Activities Classification Based on Complex-Value Convolutional Neural Network

Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks

Residual Neural Network Driven Human Activity Recognition by Exploiting FMCW Radar

Parallel LSTM-CNN Network with Radar Multispectrogram for Human Activity Recognition

A Parameter Estimation and Deep Learning Hybrid Extraction Network for Multi-Directional Human Activity Recognition Based on Mmwave Radar

Human Activity Classification Based on Micro-Doppler Signatures Separation