Abstract:The past decade has demonstrated the potential of human activity recognition (HAR) with WiFi signals owing to non-invasiveness and ubiquity. Previous research has largely concentrated on enhancing precision through sophisticated models. However, the complexity of recognition tasks has been largely neglected. Thus, the performance of the HAR system is markedly diminished when tasked with increasing complexities, such as a larger classification number, the confusion of similar actions, and signal distortion To address this issue, we eliminated conventional convolutional and recurrent backbones and proposed WiTransformer, a novel tactic based on pure Transformers. Nevertheless, Transformer-like models are typically suited to large-scale datasets as pretraining models, according to the experience of the Vision Transformer. Therefore, we adopted the Body-coordinate Velocity Profile, a cross-domain WiFi signal feature derived from the channel state information, to reduce the threshold of the Transformers. Based on this, we propose two modified transformer architectures, united spatiotemporal Transformer (UST) and separated spatiotemporal Transformer (SST) to realize WiFi-based human gesture recognition models with task robustness. SST intuitively extracts spatial and temporal data features using two encoders, respectively. By contrast, UST can extract the same three-dimensional features with only a one-dimensional encoder, owing to its well-designed structure. We evaluated SST and UST on four designed task datasets (TDSs) with varying task complexities. The experimental results demonstrate that UST has achieved recognition accuracy of 86.16% on the most complex task dataset TDSs-22, outperforming the other popular backbones. Simultaneously, the accuracy decreases by at most 3.18% when the task complexity increases from TDSs-6 to TDSs-22, which is 0.14–0.2 times that of others. However, as predicted and analyzed, SST fails because of excessive lack of inductive bias and the limited scale of the training data.

Temporal Unet: Sample Level Human Action Recognition using WiFi

WiFi-based Spatiotemporal Human Action Perception

Learning SpatioTemporal and Motion Features in a Unified 2D Network for Action Recognition

WiFi-TCN: Temporal Convolution for Human Interaction Recognition based on WiFi signal

GraSens: A Gabor Residual Anti-aliasing Sensing Framework for Action Recognition using WiFi

Temporal-Frequency Attention-Based Human Activity Recognition Using Commercial WiFi Devices

Improving human action recognition by jointly exploiting video and WiFi clues

Wi-ATCN: Attentional Temporal Convolutional Network for Human Action Prediction Using WiFi Channel State Information

We Can "See" You via Wi-Fi - WiFi Action Recognition via Vision-based Methods

U-Shape Networks are Unified Backbones for Human Action Understanding from Wi-Fi Signals

Human Activity Recognition based on WiFi Signal Using Deep Neural Network

Joint Activity Recognition and Indoor Localization with WiFi Fingerprints

Human Activity Recognition Based on Self-Attention Mechanism in WiFi Environment

Location- and Person-Independent Activity Recognition with WiFi, Deep Neural Networks, and Reinforcement Learning

A Real-time Object Detection for WiFi CSI-based Multiple Human Activity Recognition

Wi-Motion: A Robust Human Activity Recognition Using WiFi Signals

A Novel WiFi-Based Personnel Behavior Sensing With a Deep Learning Method

Human Activity and Gesture Recognition Based on WiFi Using Deep Convolutional Neural Networks

WiLDAR: WiFi Signal-Based Lightweight Deep Learning Model for Human Activity Recognition

Human Action Recognition Using Deep Learning Methods.

WiTransformer: A Novel Robust Gesture Recognition Sensing Model with WiFi