Abstract:Micro-Doppler-based human activity recognition (HAR) has been extensively researched in remote sensing. However, a well-performing classifier requires sufficient radar data of omnidirectional human movements due to the “angle sensitivity,” resulting in high costs for radar data acquisition. To address this issue, this study defines for the first time the task of “omnidirectional spectrogram generation” and proposes a method to obtain enough omnidirectional spectrograms based on the spectrograms of human movements in one direction. It significantly reduces the dependence on radar measurements with omnidirectional setups. Our method is founded upon an image translation framework that is enhanced by incorporating the concept of information disentanglement and a proposed feature-level unbiased domain translation strategy. They enable us to generate high-quality omnidirectional spectrograms at various aspect angles. The generated spectrograms are then used as training support of omnidirectional micro-Doppler-based classifiers. Subsequently, we conduct an in-depth analysis of the metric correlation between the quality of generated spectrograms and the performance of these classifiers. Finally, we introduce a method for evaluating this correlation by proposed criterion. Our method is evaluated based on a radar simulation dataset, and the results show that it significantly exceeds the compared methods, demonstrating its great potential for the task of omnidirectional recognition of human activities. Besides, we find that there is a significant correlation between classification accuracy and several image quality assessment metrics, and we believe that this investigation will serve as the foundation for future research on assessing the contribution of data generation methods to downstream tasks using quantitative measures.

Multi-domains Based Human Activity Classification in Radar

A Novel Multiperson Activity Recognition Algorithm Based on Point Clouds Measured by Millimeter-Wave MIMO Radar

Sample Intercorrelation-Based Multidomain Fusion Network for Aquatic Human Activity Recognition Using Millimeter-Wave Radar.

A Novel Real-Time Multi-Person Activity Recognition System Using Millimeter-Wave SISO Radar Data

Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

Human Activity Recognition Based on Deep Learning and Micro-Doppler Radar Data

Multi-frequency and multi-domain human activity recognition based on SFCW radar using deep learning

Human Activity Recognition Based on Mixed CNN With Radar Multi-Spectrogram

Human Activity Recognition Based on Multidomain Fusion Network for LFMCW Radar

Real-time Human Activity Classification from Radar with CNN-LSTM Network *

Radar-Based Human Activity Recognition Using Multidomain Multilevel Fused Patch-Based Learning

Human Activity Classification Based on Moving Orientation Determining Using Multistatic Micro-Doppler Radar Signals

A Parameter Estimation and Deep Learning Hybrid Extraction Network for Multi-Directional Human Activity Recognition Based on Mmwave Radar

Radar Human Activity Recognition with an Attention-Based Deep Learning Network

Omnidirectional Spectrogram Generation for Radar-based Omnidirectional Human Activity Recognition

Angle-Insensitive Human Motion and Posture Recognition Based on 4D Imaging Radar and Deep Learning Classifiers

Human Behavior Recognition Based on Multi-Dimensional Feature Learning of Millimeter-Wave Radar

Human Activity Classification with Radar Based on Multi-CNN Information Fusion

Application of multi-angle millimeter-wave radar detection in human motion behavior and micro-action recognition

4D radar simulator for human activity recognition

Multipath Exploitation for Human Activity Recognition Using a Radar Network