Abstract:Recent advances in wireless sensing techniques have made it possible to recognize hand gestures using channel state information (CSI) in commodity WiFi devices. Existing WiFi-based gesture recognition systems mainly use learning-based pattern recognition methods to recognize different gestures, however, these methods fail to work well when the locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and/or the hand gesturing size change, leading to inconsistent signal patterns caused by those factors. Although some recent efforts have been made to address the so-called "domain-dependent" gesture recognition problem, they either require prior knowledge on initial locations of the hand and WiFi devices or need to train several classifiers for the specific domains. Different from the state-of-the-art methods, we construct two distinct features from a hand-oriented view (rather than from a transceiver's view), namely, the dynamic phase vector (DPV) and motion rotation variable (MRV), which are quite consistent in characterizing a big set of handwriting gestures, despite significant change in locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and the drawing sizes. We further incorporate a hierarchical sensing framework and develop HandGest-a real-time handwriting gesture recognition system using commodity WiFi devices, to precisely recognize a great number of "in-the-air" handwritings based on the aforementioned two domain-independent features and a pipeline of specific features. Extensive experiments have been done in practical settings with 20 volunteers, evaluation results demonstrate that HandGest outperforms state-of-the-art methods on a large number of handwritings with different transceivers' location, different initial hand locations and orientations, as well as different drawing sizes. Given its superior performance, we believe that HandGest paves a new way to enhance the real-world practicality of WiFi-based gesture recognition.

Deep Adaptation Networks Based Gesture Recognition Using Commodity WiFi.

WiFine: Real-Time Gesture Recognition Using Wi-Fi with Edge Intelligence

RGC: Reliable Gesture Classification Via Wearables Using GANs-Based Data Augmentation.

WiFi-enabled Device-free Gesture Recognition for Smart Home Automation

Attention-based gesture recognition using commodity WiFi devices

Cross-user Gesture Recognition Based on Deep Domain Adaptation Networks

HandGest: Hierarchical Sensing for Robust-in-the-Air Handwriting Recognition with Commodity WiFi Devices

Deep Transfer Learning for Gesture Recognition with WiFi Signals

Towards Fully Domain‐independent Gesture Recognition Using COTS WiFi Device

Wi-AM: Enabling Cross-Domain Gesture Recognition with Commodity Wi-Fi

Unsupervised Domain Adaptation for Device-free Gesture Recognition

Attention-Based Cross-Domain Gesture Recognition Using WiFi Channel State Information

Robust Gesture Recognition Method Toward Intelligent Environment Using Wi-Fi Signals

Fine-grained Finger Gesture Recognition Using WiFi Signals

Towards Location Independent Gesture Recognition with Commodity WiFi Devices

Device Free Human Gesture Recognition with Incremental Learning.

Human Activity and Gesture Recognition Based on WiFi Using Deep Convolutional Neural Networks

A Real-Time Cross-Domain Wi-Fi-Based Gesture Recognition System for Digital Twins.

WiFi-based Cross-Domain Gesture Recognition via Modified Prototypical Networks

Dynamic Hand Gesture Detection and Recognition with WiFi Signal Based on 1D-CNN.