Abstract:Human skeleton posture reconstruction is an essential component for human–computer interactions (HCI) in various application domains. Traditional approaches usually rely on either cameras or on-body sensors, which induce privacy concerns or inconvenient practical setups. To address these practical concerns, this paper proposes a low-cost contactless skeleton posture reconstruction system, mPose, which can reconstruct a user’s 3D skeleton postures using a single mmWave device. mPose does not require the user to wear any sensors and can enable a broad range of emerging mobile applications (e.g., VR gaming and pervasive user input) via mmWave-5G ready Internet of Things (IoT) devices. Particularly, the system extracts multi-dimensional spatial information from mmWave signals which characterizes the skeleton postures in a 3D space. To mitigate the impacts of environmental changes, mPose dynamically detects the user location and extracts spatial features from the mmWave signals reflected only from the user. Furthermore, we develop a deep regression method with a domain discriminator to learn a mapping between the spatial features and the joint coordinates of human body while removing subject-specific characteristics, realizing robust posture reconstruction across users. Extensive experiments, involving 17 representative body postures, 7 subjects, and 3 indoor environments, show that mPose outperforms contemporary state-of-the-art RF-based solutions with a lower average joint error of only ∼30 mm, while achieving transferability across environments and subjects at the same time.

Articulated Postures for Subject-Specific RF Simulation.

Accurate Evaluation of RF Coil-Tissue Interactions Using a Hybrid FDTD-MoM Method

An Object-Oriented Designed Finite-Difference Time-Domain Simulator for Electromagnetic Analysis and Design in MRI

A Whole Body Statistical Shape Model for Radio Frequency Simulation

A Simulation Environment for Subject-Specific Radio Channel Modeling in Wireless Body Sensor Networks

Modelling Of Wireless Electromagnetic Environment Effects In Multi-Interconnected Metallic Cabins Using The Leapfrog Adi-Fdtd Method

Study on SAR Distribution of Human Body on the Vehicle Platform Using a Modified FDTD Method

Analysis of Wave Propagation on Human Body Based on Stratified Media Model

A Human Body Model for Efficient Numerical Characterization of UWB Signal Propagation in Wireless Body Area Networks

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

A novel dielectric conformal FDTD method for computing SAR distribution of the human body in a metallic cabin illuminated by an intentional electromagnetic pulse (IEMP)

An Efficient Simulation Technology for Characterizing the Ultra-Wide Band Signal Propagation in a Wireless Body Area Network

Numerical analysis of on-body channel for statistically-generated body shapes

A subject-specific radio propagation study in wireless body area networks

Design of Flexible Dual‐band Antenna and Metamaterial Structure for Wearable Body Area Network

Subject-specific Analysis of the On-Body Radio Propagation Channel Adopting a Parallel FDTD Code

Investigation of SAR Reduction Using Flexible Antenna with Metamaterial Structure in Wireless Body Area Network

Investigation of Localizing Precise Human Abdomen Models for Wireless Capsule Endoscopy Antenna Design

Full-wave EM simulation analysis of human body blockage by dense 2D antenna arrays

Multi-Path Model and Sensitivity Analysis for Galvanic Coupled Intra-Body Communication Through Layered Tissue

A subject-specific numerical study in UWB body-centric wireless communications