Abstract:Recent advances in wireless sensing techniques have made it possible to recognize hand gestures using channel state information (CSI) in commodity WiFi devices. Existing WiFi-based gesture recognition systems mainly use learning-based pattern recognition methods to recognize different gestures, however, these methods fail to work well when the locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and/or the hand gesturing size change, leading to inconsistent signal patterns caused by those factors. Although some recent efforts have been made to address the so-called "domain-dependent" gesture recognition problem, they either require prior knowledge on initial locations of the hand and WiFi devices or need to train several classifiers for the specific domains. Different from the state-of-the-art methods, we construct two distinct features from a hand-oriented view (rather than from a transceiver's view), namely, the dynamic phase vector (DPV) and motion rotation variable (MRV), which are quite consistent in characterizing a big set of handwriting gestures, despite significant change in locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and the drawing sizes. We further incorporate a hierarchical sensing framework and develop HandGest-a real-time handwriting gesture recognition system using commodity WiFi devices, to precisely recognize a great number of "in-the-air" handwritings based on the aforementioned two domain-independent features and a pipeline of specific features. Extensive experiments have been done in practical settings with 20 volunteers, evaluation results demonstrate that HandGest outperforms state-of-the-art methods on a large number of handwritings with different transceivers' location, different initial hand locations and orientations, as well as different drawing sizes. Given its superior performance, we believe that HandGest paves a new way to enhance the real-world practicality of WiFi-based gesture recognition.

Construct 3D Hand Skeleton with Commercial WiFi

Towards 3D Human Pose Construction Using Wifi.

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

Push the Limit of WiFi-based User Authentication Towards Undefined Gestures

3D Human Pose Estimation for Free-form Activity Using WiFi Signals

Compressed Representation for 3D Human Pose Estimation using WiFi signal

3D Human Pose Estimation for Free-from and Moving Activities Using WiFi

HandGest: Hierarchical Sensing for Robust-in-the-Air Handwriting Recognition with Commodity WiFi Devices

Fine-grained Finger Gesture Recognition Using WiFi Signals

HandOS: 3D Hand Reconstruction in One Stage

OneFi: One-Shot Recognition for Unseen Gesture via COTS WiFi

Mmhand: 3D Hand Pose Estimation Leveraging Mmwave Signals

DensePose From WiFi

Person-in-WiFi 3D: End-to-End Multi-Person 3D Pose Estimation with Wi-Fi

RF-based 3D skeletons

Can WiFi Estimate Person Pose?

Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic Signals

Towards Position-Independent Sensing for Gesture Recognition with Wi-Fi.

FingerDraw

Person-in-WiFi: Fine-grained Person Perception using WiFi

CSI-Former: Pay More Attention to Pose Estimation with WiFi