Autosen: improving automatic wifi human sensing through cross-modal autoencoder

Qian Gao,Yanling Hao,Yuanwei Liu

2024-01-09

Abstract:WiFi human sensing is highly regarded for its low-cost and privacy advantages in recognizing human activities. However, its effectiveness is largely confined to controlled, single-user, line-of-sight settings, limited by data collection complexities and the scarcity of labeled datasets. Traditional cross-modal methods, aimed at mitigating these limitations by enabling self-supervised learning without labeled data, struggle to extract meaningful features from amplitude-phase combinations. In response, we introduce AutoSen, an innovative automatic WiFi sensing solution that departs from conventional approaches. AutoSen establishes a direct link between amplitude and phase through automated cross-modal autoencoder learning. This autoencoder efficiently extracts valuable features from unlabeled CSI data, encompassing amplitude and phase information while eliminating their respective unique noises. These features are then leveraged for specific tasks using few-shot learning techniques. AutoSen's performance is rigorously evaluated on a publicly accessible benchmark dataset, demonstrating its exceptional capabilities in automatic WiFi sensing through the extraction of comprehensive cross-modal features.

Signal Processing,Human-Computer Interaction,Machine Learning

What problem does this paper attempt to address?

The paper aims to address the challenge of data annotation in practical applications of WiFi human sensing. Specifically, although WiFi human sensing technology shows great potential in recognizing human activities due to its low cost and privacy protection advantages, its effectiveness is mainly limited to controlled environments, single-user, and line-of-sight scenarios. This is primarily because the complexity of data collection and the scarcity of annotated datasets restrict its application scope. Traditional cross-modal methods, while attempting to alleviate these issues through self-supervised learning, still face difficulties in extracting meaningful features from the combination of amplitude and phase.

To address the above challenges, the paper proposes AutoSen, an innovative automatic WiFi sensing solution. AutoSen establishes a direct link between amplitude and phase through automated cross-modal autoencoder learning. This autoencoder can efficiently extract valuable features from unannotated Channel State Information (CSI) data while eliminating respective noise. These features are then applied to specific tasks using few-shot learning techniques. Experimental results show that AutoSen performs excellently on public benchmark datasets, demonstrating its strong capability in automatic WiFi sensing, especially in extracting comprehensive cross-modal features. Additionally, AutoSen improves the effectiveness of feature extraction by introducing a cross-modal autoencoder module and trains more effective encoders without the need for annotated data. Comparative experiments validate the superiority of cross-modal features over single-modal features, and the model performance is further optimized by adjusting the size of latent features.