Abstract:Fine-grained person perception such as body segmentation and pose estimation has been achieved with many 2D and 3D sensors such as RGB/depth cameras, radars (e.g., RF-Pose) and LiDARs. These sensors capture 2D pixels or 3D point clouds of person bodies with high spatial resolution, such that the existing Convolutional Neural Networks can be directly applied for perception. In this paper, we take one step forward to show that fine-grained person perception is possible even with 1D sensors: WiFi antennas. To our knowledge, this is the first work to perceive persons with pervasive WiFi devices, which is cheaper and power efficient than radars and LiDARs, invariant to illumination, and has little privacy concern comparing to cameras. We used two sets of off-the-shelf WiFi antennas to acquire signals, i.e., one transmitter set and one receiver set. Each set contains three antennas lined-up as a regular household WiFi router. The WiFi signal generated by a transmitter antenna, penetrates through and reflects on human bodies, furniture and walls, and then superposes at a receiver antenna as a 1D signal sample (instead of 2D pixels or 3D point clouds). We developed a deep learning approach that uses annotations on 2D images, takes the received 1D WiFi signals as inputs, and performs body segmentation and pose estimation in an end-to-end manner. Experimental results on over 100000 frames under 16 indoor scenes demonstrate that Person-in-WiFi achieved person perception comparable to approaches using 2D images.

Multi-View Human Perception with WiFi

WiWalk: Gait-Based Dual-User Identification Using WiFi Device.

Person-in-WiFi: Fine-grained Person Perception using WiFi

Person-in-WiFi 3D: End-to-End Multi-Person 3D Pose Estimation with Wi-Fi

Can WiFi Estimate Person Pose?

We Can "See" You via Wi-Fi - WiFi Action Recognition via Vision-based Methods

DensePose From WiFi

WiFi-based non-contact human presence detection technology

FreeSense:Indoor Human Identification with WiFi Signals

WiFi-based Spatiotemporal Human Action Perception

Robust Person Identification: A WiFi Vision-based Approach

Seeing the Unseen: Wifi-based 2D Human Pose Estimation via an Evolving Attentive Spatial-Frequency Network

Improving human action recognition by jointly exploiting video and WiFi clues

From Point to Space: 3D Moving Human Pose Estimation Using Commodity WiFi

Multi-User Activity Recognition and Tracking Using Commodity WiFi

Joint Human Orientation-Activity Recognition Using WiFi Signals for Human-Machine Interaction

AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFi

Unveiling personnel movement in a larger indoor area with a non-overlapping multi-camera system

Wi-fi see it all: generative adversarial network-augmented versatile wi-fi imaging

Fear of amalgam: dentists' experiences in the Nordic countries.

CSI-Former: Pay More Attention to Pose Estimation with WiFi