SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensing

Jianfei Yang,Xinyan Chen,Dazhuo Wang,Han Zou,Chris Xiaoxuan Lu,Sumei Sun,Lihua Xie

DOI: https://doi.org/10.48550/arXiv.2207.07859

2023-02-17

Abstract:WiFi sensing has been evolving rapidly in recent years. Empowered by propagation models and deep learning methods, many challenging applications are realized such as WiFi-based human activity recognition and gesture recognition. However, in contrast to deep learning for visual recognition and natural language processing, no sufficiently comprehensive public benchmark exists. In this paper, we review the recent progress on deep learning enabled WiFi sensing, and then propose a benchmark, SenseFi, to study the effectiveness of various deep learning models for WiFi sensing. These advanced models are compared in terms of distinct sensing tasks, WiFi platforms, recognition accuracy, model size, computational complexity, feature transferability, and adaptability of unsupervised learning. It is also regarded as a tutorial for deep learning based WiFi sensing, starting from CSI hardware platform to sensing algorithms. The extensive experiments provide us with experiences in deep model design, learning strategy skills and training techniques for real-world applications. To the best of our knowledge, this is the first benchmark with an open-source library for deep learning in WiFi sensing research. The benchmark codes are available at <a class="link-external link-https" href="https://github.com/xyanchen/WiFi-CSI-Sensing-Benchmark" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Artificial Intelligence,Signal Processing

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the current lack of a comprehensive public benchmark test set in the field of WiFi sensing. Although deep - learning methods have made remarkable progress in WiFi - sensing applications, such as WiFi - based human - activity recognition and gesture recognition, compared with deep - learning in computer vision and natural - language processing, the field of WiFi sensing still does not have a sufficiently comprehensive public benchmark. This has led to the following problems:

1. **Inconsistent model evaluation**: The lack of unified evaluation criteria among different studies makes it difficult to fairly compare the performance of various deep - learning models on WiFi - sensing tasks.
2. **Insufficient data sets**: Existing data sets are not sufficient to support a comprehensive evaluation of different WiFi platforms, different tasks, and different feature - extraction methods.
3. **Limited application of transfer learning and unsupervised learning**: There is a lack of systematic research to explore how to use transfer - learning and unsupervised - learning techniques to improve the performance of WiFi sensing, especially when labeled data is scarce.

To solve these problems, the paper proposes a benchmark test library and model zoo named SenseFi, aiming to study the effectiveness of various deep - learning models in WiFi - sensing tasks. Specifically, SenseFi includes the following contributions:

- **Model overview**: Analyze and summarize how deep - learning models widely used in computer vision and natural - language processing play a role in WiFi sensing, especially in terms of network structure and feature extraction.
- **Data - set collection**: Select two public data sets (UT - HAR and Widar), and collect two new data sets (NTU - Fi HAR and Human - ID). These data sets cover different CSI platforms and can be used for benchmark - testing deep - learning methods.
- **Transfer learning**: Explore knowledge - transfer schemes across different sensing tasks and benchmark their performance on all models.
- **Unsupervised learning**: Study contrast - learning methods, train feature extractors with unlabeled data, and reduce the labeling cost.
- **Open - source library**: Develop the SenseFi library and open - source the benchmark - testing code. This is the first benchmark - testing work for advanced deep models and learning schemes in the field of WiFi sensing, providing comprehensive evidence and tools for future research.

Through these contributions, SenseFi aims to fill the current gap between deep - learning and WiFi - sensing research, provide a comprehensive evaluation framework, and promote the further development of this field.