Abstract:Radar is widely used in human activity recognition (HAR). The radar-based HAR algorithms can be roughly categorized into feature map-based and point cloud-based. Between the two, the point cloud-based algorithms are more suitable for multiperson activity recognition (MPAR) tasks due to the spatial properties of point clouds and are therefore increasingly attracting attention. However, most existing point cloud-based algorithms make decisions by utilizing either Doppler or coordinate features of point clouds, which are not sufficient to characterize the activity; the remaining algorithms have large randomness in extracting both features. Neither of these algorithms can fully exploit the advantage of feature fusion, which is the key to recognition performance. To address this shortcoming, this article proposes a novel MPAR algorithm. First, a feature mapping approach is proposed and defined in equation form, the Doppler, range, azimuth, and elevation features of the point clouds are calculated and accumulated sequentially, so we can obtain the four time-domain feature maps. Second, with the four feature maps as inputs, a four-channel convolutional neural network (CNN) classification model with channel attention is trained for MPAR tasks. Datasets of multi-person activities are collected respectively under indoor circumstances and aquatic circumstances using the millimeter-wave multiple-input–multiple-output (MIMO) radar platform. The dataset-based evaluation performance shows that the proposed algorithm achieves accuracy results of 96.09% for the indoor-MPAR task and 93.97% for the aquatic-MPAR task, and outperforms three conventional point cloud-based algorithms in terms of the overall MPAR accuracy, the generalization ability to the aquatic activity recognition, and the robustness of distance and headcount.

A Novel Radar Point Cloud Generation Method for Robot Environment Perception

A Novel Radar Point Cloud Generation Method for Robot Environment Perception

PCGNet: Point Cloud Generation Network for 3D Perception using Monocular Images and Radar

Radar Style Transfer for Metric Robot Localisation on Lidar Maps

A Novel Multiperson Activity Recognition Algorithm Based on Point Clouds Measured by Millimeter-Wave MIMO Radar

An Improved Scheme for High-Resolution Point Cloud Map Generation Based on FMCW Radar

Radar2: Passive Spy Radar Detection and Localization Using COTS Mmwave Radar

A Robust Robot Perception Framework for Complex Environments Using Multiple Mmwave Radars

Enhancing mmWave Radar Point Cloud via Visual-inertial Supervision

Millimetre-wave Radar for Low-Cost 3D Imaging: A Performance Study

R2P: A Deep Learning Model from mmWave Radar to Point Cloud

Dense 3D Point Cloud Environmental Mapping Using Millimeter-Wave Radar

DenserRadar: A 4D millimeter-wave radar point cloud detector based on dense LiDAR point clouds

Pointillism: Accurate 3D bounding box estimation with multi-radars

A New Automotive Radar 4D Point Clouds Detector by Using Deep Learning

RadCloud: Real-Time High-Resolution Point Cloud Generation Using Low-Cost Radars for Aerial and Ground Vehicles

Diffusion-Based Point Cloud Super-Resolution for mmWave Radar Data

High Resolution Point Clouds from mmWave Radar

A Data-Driven Method for Indoor Radar Ghost Recognition with Environmental Mapping