Abstract:Radar is widely used in human activity recognition (HAR). The radar-based HAR algorithms can be roughly categorized into feature map-based and point cloud-based. Between the two, the point cloud-based algorithms are more suitable for multiperson activity recognition (MPAR) tasks due to the spatial properties of point clouds and are therefore increasingly attracting attention. However, most existing point cloud-based algorithms make decisions by utilizing either Doppler or coordinate features of point clouds, which are not sufficient to characterize the activity; the remaining algorithms have large randomness in extracting both features. Neither of these algorithms can fully exploit the advantage of feature fusion, which is the key to recognition performance. To address this shortcoming, this article proposes a novel MPAR algorithm. First, a feature mapping approach is proposed and defined in equation form, the Doppler, range, azimuth, and elevation features of the point clouds are calculated and accumulated sequentially, so we can obtain the four time-domain feature maps. Second, with the four feature maps as inputs, a four-channel convolutional neural network (CNN) classification model with channel attention is trained for MPAR tasks. Datasets of multi-person activities are collected respectively under indoor circumstances and aquatic circumstances using the millimeter-wave multiple-input–multiple-output (MIMO) radar platform. The dataset-based evaluation performance shows that the proposed algorithm achieves accuracy results of 96.09% for the indoor-MPAR task and 93.97% for the aquatic-MPAR task, and outperforms three conventional point cloud-based algorithms in terms of the overall MPAR accuracy, the generalization ability to the aquatic activity recognition, and the robustness of distance and headcount.

A Lightweight Multiscale Neural Network for Indoor Human Activity Recognition Based on Macro and Micro-Doppler Features

Indoor Human Motion Recognition Method Based on Kernel-Distance Doppler Velocity Estimation and Lightweight Network

A Novel Multiperson Activity Recognition Algorithm Based on Point Clouds Measured by Millimeter-Wave MIMO Radar

Radar Human Activity Recognition with an Attention-Based Deep Learning Network

Indoor Human Action Recognition Based on Millimeter-Wave Radar Micro-Doppler Signature

Human Motion Recognition by Micro-Doppler Features and Concatenated CNN-LSTM Network

Human Activity Recognition Based on Deep Learning and Micro-Doppler Radar Data

A Multi-Domain Fusion Human Motion Recognition Method Based on Lightweight Network

Generalizable Indoor Human Activity Recognition Method Based on Micro-Doppler Corner Point Cloud and Dynamic Graph Learning

Resolution-Adaptive Micro-Doppler Spectrogram for Human Activity Recognition

Multi-frequency and multi-domain human activity recognition based on SFCW radar using deep learning

Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

Sparsity-based Human Activity Recognition with PointNet using a Portable FMCW Radar

Generalization Ability Analysis of Through-the-Wall Radar Human Activity Recognition

Human Activity Recognition Based on Mixed CNN With Radar Multi-Spectrogram

A Parameter Estimation and Deep Learning Hybrid Extraction Network for Multi-Directional Human Activity Recognition Based on Mmwave Radar

Human Motion Recognition With Spatial-Temporal-ConvLSTM Network Using Dynamic Range-Doppler Frames Based on Portable FMCW Radar

Person Identification with Limited Training Data Using Radar Micro‐doppler Signatures

DyLiteRADHAR: Dynamic Lightweight Slowfast Network for Human Activity Recognition Using MMWAVE Radar

Parallel LSTM-CNN Network with Radar Multispectrogram for Human Activity Recognition

A lightweight hybrid vision transformer network for radar-based human activity recognition