Abstract:Micro-Doppler-based human activity recognition (HAR) has been extensively researched in remote sensing. However, a well-performing classifier requires sufficient radar data of omnidirectional human movements due to the “angle sensitivity,” resulting in high costs for radar data acquisition. To address this issue, this study defines for the first time the task of “omnidirectional spectrogram generation” and proposes a method to obtain enough omnidirectional spectrograms based on the spectrograms of human movements in one direction. It significantly reduces the dependence on radar measurements with omnidirectional setups. Our method is founded upon an image translation framework that is enhanced by incorporating the concept of information disentanglement and a proposed feature-level unbiased domain translation strategy. They enable us to generate high-quality omnidirectional spectrograms at various aspect angles. The generated spectrograms are then used as training support of omnidirectional micro-Doppler-based classifiers. Subsequently, we conduct an in-depth analysis of the metric correlation between the quality of generated spectrograms and the performance of these classifiers. Finally, we introduce a method for evaluating this correlation by proposed criterion. Our method is evaluated based on a radar simulation dataset, and the results show that it significantly exceeds the compared methods, demonstrating its great potential for the task of omnidirectional recognition of human activities. Besides, we find that there is a significant correlation between classification accuracy and several image quality assessment metrics, and we believe that this investigation will serve as the foundation for future research on assessing the contribution of data generation methods to downstream tasks using quantitative measures.

Generalizable Indoor Human Activity Recognition Method Based on Micro-Doppler Corner Point Cloud and Dynamic Graph Learning

A Novel Multiperson Activity Recognition Algorithm Based on Point Clouds Measured by Millimeter-Wave MIMO Radar

Adaptive Micro-Doppler Corner Feature Extraction Method Based on Difference of Gaussian Filter and Deformable Convolution

A Novel Real-Time Multi-Person Activity Recognition System Using Millimeter-Wave SISO Radar Data

Generalization Ability Analysis of Through-the-Wall Radar Human Activity Recognition

A Lightweight Multiscale Neural Network for Indoor Human Activity Recognition Based on Macro and Micro-Doppler Features

Indoor Human Motion Recognition Method Based on Kernel-Distance Doppler Velocity Estimation and Lightweight Network

Mmbehavior: Human Activity Recognition System of Millimeter-Wave Radar Point Clouds Based on Deep Recurrent Neural Network

Indoor 3D Human Pose Estimation Using Single Millimeter-wave Radar and Conditional Generative Adversarial Network

Radar-based Human Activity Recognition Using Two-Dimensional Feature Extraction

MMPoint-GNN: Graph Neural Network with Dynamic Edges for Human Activity Recognition Through a Millimeter-Wave Radar

Human Activity Recognition Based on Deep Learning and Micro-Doppler Radar Data

A Parameter Estimation and Deep Learning Hybrid Extraction Network for Multi-Directional Human Activity Recognition Based on Mmwave Radar

Human Activity Recognition of Millimeter-wave Radar Based on DRCNet

Indoor Human Action Recognition Based on Millimeter-Wave Radar Micro-Doppler Signature

Radar Feature Analysis of Human Activity Recognition under Multi-view Scenes

Person Identification with Limited Training Data Using Radar Micro‐doppler Signatures

Omnidirectional Spectrogram Generation for Radar-based Omnidirectional Human Activity Recognition

Residual Neural Network Driven Human Activity Recognition by Exploiting FMCW Radar

Segmented Convolutional Gated Recurrent Neural Networks for Human Activity Recognition in Ultra-Wideband Radar.

Radar Point Clouds Processing for Human Activity Classification using Convolutional Multilinear Subspace Learning