Abstract:Through-wall radar (TWR) can penetrate through non-metallic occlusions and detect hidden human targets. Nonetheless, because of its low imaging spatial resolution, most of the current methods can only obtain the low-level human detecting information from the TWR signals, for example, the human trunk positions. More complex human information, such as complete pose outline, has remained intractable. In this paper, a novel self-supervised human pose recovery method for TWR based on convolutional neural networks (CNNs) is proposed. We adopt a self-supervised teacher-student learning pipeline for the method. During training, we attach a camera to the radar to simultaneously collect pairs of RGB images and TWR signals. A vision-based pretrained teacher network extracts human pose information from RGB images and generates the human outline masks as pseudo labels. A student network learns to extract the patterns in corresponding TWR signals and predicts the masks that are close to the labels above. There is no external supervision in the training process, so it is unnecessary to label the dataset manually. After training, the method can recover accurate human pose just from TWR signals. The experiments are conducted in two different scenarios. In a scenario without wall occlusion, we collected synchronized radar signals and images for method training and accuracy evaluation. The quantitative results show comparable predictions with the state-of-the-art methods in non-wallocclusive scenarios. In a wall-occlusive scenario, we solely collect radar signals for generalization evaluation. The accurate qualitative predictions show complete human pose recovery with wall occlusions.

Through-Wall Human Motion Representation Via Autoencoder-Self Organized Mapping Network

Human Motion Serialization Recognition With Through-The-Wall Radar

RPCA-Based High Resolution Through-the-Wall Human Motion Feature Extraction and Classification

TWR-MCAE: A Data Augmentation Method for Through-the-Wall Radar Human Motion Recognition

Human Detection in Realistic Through-the-Wall Environments using Raw Radar ADC Data and Parametric Neural Networks

RPCA-Based High Resolution Through-the-Wall Human Motion Detection and Classification

Through-Wall Human Motion Recognition Based on Transfer Learning and Ensemble Learning

Detection of human's motions through a wall using UWB radar

Through-Wall Tracking of Human Movers Using Continuous-Wave Radar

Synthesis of Through-Wall Micro-Doppler Signatures of Human Motions Using Generative Adversarial Networks

Through-Wall Human Pose Reconstruction Based on Cross-Modal Learning and Self-Supervised Learning

Through-Wall Human Motion Recognition Based on Semi-Manual Network

Recovering Human Pose and Shape from Through-the-Wall Radar Images

Through-Wall Tracking of Human Movers Using Joint Slope-Demodulation and Adaptive Filter Processing

Self-supervised Human Pose Recovery for Through-wall Radar Based on Convolutional Neural Networks

Triple-Link Fusion Decision Method for Through-the-Wall Radar Human Motion Recognition

Range-Max Enhanced Ultrawideband Micro-Doppler Signatures of Behind-the-Wall Indoor Human Motions

Indoor 3D Human Pose Estimation Using Single Millimeter-wave Radar and Conditional Generative Adversarial Network

Through-the-Wall Micro-Doppler De-Wiring Technique Via Cycle-Consistent Adversarial Network

Through-Wall Human Pose Estimation by Mutual Information Maximizing Deeply-Supervised Nets

A Multi-Domain Fusion Human Motion Recognition Method Based on Lightweight Network