Abstract:Recent advances in wireless sensing techniques have made it possible to recognize hand gestures using channel state information (CSI) in commodity WiFi devices. Existing WiFi-based gesture recognition systems mainly use learning-based pattern recognition methods to recognize different gestures, however, these methods fail to work well when the locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and/or the hand gesturing size change, leading to inconsistent signal patterns caused by those factors. Although some recent efforts have been made to address the so-called "domain-dependent" gesture recognition problem, they either require prior knowledge on initial locations of the hand and WiFi devices or need to train several classifiers for the specific domains. Different from the state-of-the-art methods, we construct two distinct features from a hand-oriented view (rather than from a transceiver's view), namely, the dynamic phase vector (DPV) and motion rotation variable (MRV), which are quite consistent in characterizing a big set of handwriting gestures, despite significant change in locations of transceivers, the relative location and orientation of the hand with respect to transceivers, and the drawing sizes. We further incorporate a hierarchical sensing framework and develop HandGest-a real-time handwriting gesture recognition system using commodity WiFi devices, to precisely recognize a great number of "in-the-air" handwritings based on the aforementioned two domain-independent features and a pipeline of specific features. Extensive experiments have been done in practical settings with 20 volunteers, evaluation results demonstrate that HandGest outperforms state-of-the-art methods on a large number of handwritings with different transceivers' location, different initial hand locations and orientations, as well as different drawing sizes. Given its superior performance, we believe that HandGest paves a new way to enhance the real-world practicality of WiFi-based gesture recognition.

Hybrid Architecture for Handwriting Perceptual Service Based on Edge Computing

Cloud-Edge Collaborative Human Activity Recognition System Design and Implementation.

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Smart-Edge-CoCaCo: AI-Enabled Smart Edge with Joint Computation, Caching, and Communication in Heterogeneous IoT

A Sustainable Multi-modal Multi-layer Emotion-aware Service at the Edge

Hetero-Edge: Orchestration of Real-time Vision Applications on Heterogeneous Edge Clouds

HandGest: Hierarchical Sensing for Robust-in-the-Air Handwriting Recognition with Commodity WiFi Devices

Design of Smart Home System Based on Collaborative Edge Computing and Cloud Computing

Offload Shaping for Wearable Cognitive Assistance

Spider-Inspired HCCapture: Beware That What You Are Writing on Mobile Devices Is Becoming Prey for Spiders

A Dynamic Service Migration Mechanism in Edge Cognitive Computing

Task Offloading And Resource Scheduling In Hybrid Edge-Cloud Networks

The mechanism of digitized landscape architecture design under edge computing

Privacy-Preserving Image Watermark Embedding Method Based on Edge Computing

HandiText: Handwriting Recognition Based on Dynamic Characteristics with Incremental LSTM

Construction of an Intelligent APP for Dance Training Mobile Information Management Platform Based on Edge Computing

Channel Fingerprint Packet Authentication Method Based on Edge Computing Cooperation

Secure and Privacy-Preserving Human Interaction Recognition of Pervasive Healthcare Monitoring

An empirical study of latency in an emerging class of edge computing applications for wearable cognitive assistance

Word-Fi: Accurate Handwrite System Empowered by Wireless Backscattering and Machine Learning

Human-Like Hybrid Caching in Software-defined Edge Cloud