Abstract:Motion tracking systems based on optical sensors typically often suffer from issues, such as poor lighting conditions, occlusion, limited coverage, and may raise privacy concerns. More recently, radio frequency (RF)-based approaches using commercial WiFi devices have emerged which offer low-cost ubiquitous sensing whilst preserving privacy. However, the output of an RF sensing system, such as Range-Doppler spectrograms, cannot represent human motion intuitively and usually requires further processing. In this study, MDPose, a novel framework for human skeletal motion reconstruction based on WiFi micro-Doppler signatures, is proposed. It provides an effective solution to track human activities by reconstructing a skeleton model with 17 key points, which can assist with the interpretation of conventional RF sensing outputs in a more understandable way. Specifically, MDPose has various incremental stages to gradually address a series of challenges: First, a denoising algorithm is implemented to remove any unwanted noise that may affect the feature extraction and enhance weak Doppler signatures. Secondly, the convolutional neural network (CNN)-recurrent neural network (RNN) architecture is applied to learn temporal-spatial dependency from clean micro-Doppler signatures and restore key points' velocity information. Finally, a pose optimising mechanism is employed to estimate the initial state of the skeleton and to limit the increase of error. We have conducted comprehensive tests in a variety of environments using numerous subjects with a single receiver radar system to demonstrate the performance of MDPose, and report 29.4mm mean absolute error over all key points positions, which outperforms state-of-the-art RF-based pose estimation systems.

POSE ESTIMATION USING RADIO FREQUENCY SIGNALS

Radio-Frequency-Identification-Based 3D Human Pose Estimation Using Knowledge-Level Technique

Based on network probabilistic graph human pose segmentation algorithm

UWB-Radar-Based 3D Human Pose Estimation Using Micro-Range/Micro-Doppler Images

Accurate Human Pose Estimation using RF Signals

Drogue Pose Estimation Based on Ultraviolet Camera and Asymmetric Markers.

Human Identification by Means of Optoelectronic Reservoir Computing

RFPose-OT: RF-Based 3D Human Pose Estimation via Optimal Transport Theory

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Are You Sitting Right?-Sitting Posture Recognition Using RF Signals

MDPose: Human Skeletal Motion Reconstruction Using WiFi Micro-Doppler Signatures

Three-Dimensional Human Pose Estimation from Micro-Doppler Signature Based on SISO UWB Radar

Through-Wall Human Pose Estimation Using Radio Signals

RF-based Multi-view Pose Machine for Multi-Person 3D Pose Estimation.

RFnet: Automatic Gesture Recognition and Human Identification Using Time Series RFID Signals

RF-based 3D skeletons

DensePose From WiFi

CSI-Former: Pay More Attention to Pose Estimation with WiFi

RF-Sign: Position-Independent Sign Language Recognition Using Passive RFID Tags

mm-Pose: Real-Time Human Skeletal Posture Estimation Using mmWave Radars and CNNs

RF-Kinect