Abstract:In recent years, considerable endeavors have been devoted to exploring Wi-Fi-based sensing technologies by modeling the intricate mapping between received signals and corresponding human activities. However, the inherent complexity of Wi-Fi signals poses significant challenges for practical applications due to their pronounced susceptibility to deployment environments. To address this challenge, we delve into the distinctive characteristics of Wi-Fi signals and distill three pivotal factors that can be leveraged to enhance generalization capabilities of deep learning-based Wi-Fi sensing models: 1) effectively capture valuable input to mitigate the adverse impact of noisy measurements; 2) adaptively fuse complementary information from multiple Wi-Fi devices to boost the distinguishability of signal patterns associated with different activities; 3) extract generalizable features that can overcome the inconsistent representations of activities under different environmental conditions (e.g., locations, orientations). Leveraging these insights, we design a novel and unified sensing framework based on Wi-Fi signals, dubbed UniFi, and use gesture recognition as an application to demonstrate its effectiveness. UniFi achieves robust and generalizable gesture recognition in real-world scenarios by extracting discriminative and consistent features unrelated to environmental factors from pre-denoised signals collected by multiple transceivers. To achieve this, we first introduce an effective signal preprocessing approach that captures the applicable input data from noisy received signals for the deep learning model. Second, we propose a multi-view deep network based on spatio-temporal cross-view attention that integrates multi-carrier and multi-device signals to extract distinguishable information. Finally, we present the mutual information maximization as a regularizer to learn environment-invariant representations via contrastive loss without requiring access to any signals from unseen environments for practical adaptation. Extensive experiments on the Widar 3.0 dataset demonstrate that our proposed framework significantly outperforms state-of-the-art approaches in different settings (99% and 90%-98% accuracy for in-domain and cross-domain recognition without additional data collection and model training).

Wi-Learner: Towards One-shot Learning for Cross-Domain Wi-Fi based Gesture Recognition

Wi-Learner

WiFine: Real-Time Gesture Recognition Using Wi-Fi with Edge Intelligence

Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi

Widar3.0: Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi

Wi-AM: Enabling Cross-Domain Gesture Recognition with Commodity Wi-Fi

WiHF: Enable User Identified Gesture Recognition with WiFi

CrossGR: Accurate and Low-cost Cross-target Gesture Recognition Using Wi-Fi

WiHF: Gesture and User Recognition With WiFi

Robust Gesture Recognition Method Toward Intelligent Environment Using Wi-Fi Signals

Device-Free Sensing for Gesture Recognition by Wi-Fi Communication Signal Based on Auto-encoder/decoder Neural Network

Towards Device-Free Cross-Scene Gesture Recognition from Limited Samples in Integrated Sensing and Communication

A Resource-Efficient Cross-Domain Sensing Method for Device-Free Gesture Recognition with Federated Transfer Learning

ML-WiGR: a meta-learning-based approach for cross-domain device-free gesture recognition

CrossGR

Generalizing Wireless Cross-Multiple-Factor Gesture Recognition to Unseen Domains

One is Enough: Enabling One-shot Device-free Gesture Recognition with COTS WiFi

Practical Device-Free Gesture Recognition Using WiFi Signals Based on Metalearning

Cross-Domain Gesture Recognition Via Learning Spatiotemporal Features in Wi-Fi Sensing.

Towards Position-Independent Sensing for Gesture Recognition with Wi-Fi.

UniFi: A Unified Framework for Generalizable Gesture Recognition with Wi-Fi Signals Using Consistency-guided Multi-View Networks