Abstract:Radio-frequency (RF) based human sensing technologies, due to their great practical value in various applications and privacy-preserving nature, have gained tremendous attention in recent years. However, without fully exploiting the characteristics of radio signals, the performance of existing methods are still limited. First, RF features of the moving human body have different representations in dimensions such as channel and scale, which is challenging when performing feature fusion. Besides, the human body is specularly reflective with respect to the radar, which means the human body cannot be fully captured by a single RF snapshot. Therefore, the radar signal reflected by the human body is sparse and incomplete, which is difficult to extract high-quality features for 3D human pose estimation. In this paper, we present the RF-based Pose Machines (RPM), a novel framework which can generate 3D skeletons from RF signals. Considering the characteristics of RF signals, RPM includes several modules to overcome the challenges. Firstly, a Multidimensional Feature Fusion (MFF) backbone is designed to effectively fuse radio signals based on the channels' correlation and maintain high-quality feature via a multi-scale fusion block. A Spatio-Temporal Attention network is then designed to reconstruct 3D skeletons by modeling the non-local spatio-temporal relationships. To evaluate the performance of our RPM framework, we construct a large-scale dataset of synchronized 3D skeletons and RF signals, RFSkeleton3D. Our experimental results show that RPM locates 3D key points of the human body with an average error of 5.71cm and maintains its performance in new environments with occlusion or bad illumination. The dataset and codes will be made in public.

RF-Care: RFID-based Human Pose Estimation for Nursing-care Applications under Visual Occlusion

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

Are You Sitting Right?-Sitting Posture Recognition Using RF Signals

RF-Kinect

SitR: Sitting Posture Recognition Using RF Signals

Accurate Human Pose Estimation using RF Signals

An Integrated Wireless Wearable Sensor System for Posture Recognition and Indoor Localization

OCHID-Fi: Occlusion-Robust Hand Pose Estimation in 3D via RF-Vision

Radio-Frequency-Identification-Based 3D Human Pose Estimation Using Knowledge-Level Technique

A Privacy-Preserving and Unobtrusive Sitting Posture Recognition System Via Pressure Array Sensor and Infrared Array Sensor for Office Workers

RFPose-OT: RF-Based 3D Human Pose Estimation via Optimal Transport Theory

Intelligent Mattress Monitoring System Based on RFID RSSI Difference Array

RF-based 3D skeletons

Real-Time Short-Range Human Posture Estimation Using mmWave Radars and Neural Networks

Reconfigurable Intelligent Surfaces based RF Sensing: Design, Optimization, and Implementation

HeadSee: Device-free head gesture recognition with commodity RFID

Reconfigurable Intelligent Surface Based RF Sensing: Design, Optimization, and Implementation

Wise Information Technology of Med: Human Pose Recognition in Elderly Care

RF-based Multi-view Pose Machine for Multi-Person 3D Pose Estimation.

Fast 3D Human Pose Estimation Using RF Signals

Toward a Wearable RFID System for Real-Time Activity Recognition Using Radio Patterns