Abstract:Recent advances in wireless sensing techniques have made it possible to recognize hand gestures using channel state information (CSI) in commodity WiFi devices. Existing WiFi-based gesture recognition systems mainly use learning-based pattern recognition methods to recognize different gestures, however, these methods fail to work well when the locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and/or the hand gesturing size change, leading to inconsistent signal patterns caused by those factors. Although some recent efforts have been made to address the so-called "domain-dependent" gesture recognition problem, they either require prior knowledge on initial locations of the hand and WiFi devices or need to train several classifiers for the specific domains. Different from the state-of-the-art methods, we construct two distinct features from a hand-oriented view (rather than from a transceiver's view), namely, the dynamic phase vector (DPV) and motion rotation variable (MRV), which are quite consistent in characterizing a big set of handwriting gestures, despite significant change in locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and the drawing sizes. We further incorporate a hierarchical sensing framework and develop HandGest-a real-time handwriting gesture recognition system using commodity WiFi devices, to precisely recognize a great number of "in-the-air" handwritings based on the aforementioned two domain-independent features and a pipeline of specific features. Extensive experiments have been done in practical settings with 20 volunteers, evaluation results demonstrate that HandGest outperforms state-of-the-art methods on a large number of handwritings with different transceivers' location, different initial hand locations and orientations, as well as different drawing sizes. Given its superior performance, we believe that HandGest paves a new way to enhance the real-world practicality of WiFi-based gesture recognition.

Dynamic Hand Gesture Detection and Recognition with WiFi Signal Based on 1D-CNN.

WiFine: Real-Time Gesture Recognition Using Wi-Fi with Edge Intelligence

A RD-T Network for Hand Gesture Recognition Based on Millimeter-Wave Sensor

Recognition for Human Gestures Based on Convolutional Neural Network Using the Off-the-Shelf Wi-Fi Routers

Dynamic Gesture Recognition with Wi-Fi Based on Signal Processing and Machine Learning

Fine-grained Finger Gesture Recognition Using WiFi Signals

Robust Gesture Recognition Method Toward Intelligent Environment Using Wi-Fi Signals

Dynamic Gesture Recognition Using Wireless Signals with Less Disturbance

Just‐in‐Time Human Gesture Recognition Using WiFi Signals

WiFi-enabled Device-free Gesture Recognition for Smart Home Automation

Attention-based gesture recognition using commodity WiFi devices

HandGest: Hierarchical Sensing for Robust-in-the-Air Handwriting Recognition with Commodity WiFi Devices

Towards Robust Gesture Recognition by Characterizing the Sensing Quality of WiFi Signals

Towards Position-independent Gesture Recognition Based on WiFi by Subcarrier Selection and Gesture Code

Deep Transfer Learning for Gesture Recognition with WiFi Signals

Dynamic Hand Gesture Recognition Based on Parallel HMM Using Wireless Signals

A Novel WiFi Gesture Recognition Method Based on CNN-LSTM and Channel Attention

A Real-Time Cross-Domain Wi-Fi-Based Gesture Recognition System for Digital Twins.

Deep Adaptation Networks Based Gesture Recognition Using Commodity WiFi.

Towards Location Independent Gesture Recognition with Commodity WiFi Devices

A New Method of Human Gesture Recognition Using Wi-Fi Signals Based on XGBoost