Abstract:The past decade has demonstrated the potential of human activity recognition (HAR) with WiFi signals owing to non-invasiveness and ubiquity. Previous research has largely concentrated on enhancing precision through sophisticated models. However, the complexity of recognition tasks has been largely neglected. Thus, the performance of the HAR system is markedly diminished when tasked with increasing complexities, such as a larger classification number, the confusion of similar actions, and signal distortion To address this issue, we eliminated conventional convolutional and recurrent backbones and proposed WiTransformer, a novel tactic based on pure Transformers. Nevertheless, Transformer-like models are typically suited to large-scale datasets as pretraining models, according to the experience of the Vision Transformer. Therefore, we adopted the Body-coordinate Velocity Profile, a cross-domain WiFi signal feature derived from the channel state information, to reduce the threshold of the Transformers. Based on this, we propose two modified transformer architectures, united spatiotemporal Transformer (UST) and separated spatiotemporal Transformer (SST) to realize WiFi-based human gesture recognition models with task robustness. SST intuitively extracts spatial and temporal data features using two encoders, respectively. By contrast, UST can extract the same three-dimensional features with only a one-dimensional encoder, owing to its well-designed structure. We evaluated SST and UST on four designed task datasets (TDSs) with varying task complexities. The experimental results demonstrate that UST has achieved recognition accuracy of 86.16% on the most complex task dataset TDSs-22, outperforming the other popular backbones. Simultaneously, the accuracy decreases by at most 3.18% when the task complexity increases from TDSs-6 to TDSs-22, which is 0.14–0.2 times that of others. However, as predicted and analyzed, SST fails because of excessive lack of inductive bias and the limited scale of the training data.

Human Activity Recognition Using IR-UWB Radar: A Lightweight Transformer Approach

A lightweight hybrid vision transformer network for radar-based human activity recognition

Advancing IR-UWB Radar Human Activity Recognition With Swin-Transformers and Supervised Contrastive Learning

A Novel Real-Time Multi-Person Activity Recognition System Using Millimeter-Wave SISO Radar Data

Human Activity Recognition Based on Deep Learning and Micro-Doppler Radar Data

A human activity recognition method based on Vision Transformer

Visualization As Intermediate Representations (VLAIR) for Human Activity Recognition.

Human State Recognition Using Ultra Wideband Radar Based On CvT

Human Activity Recognition Based on Self-Attention Mechanism in WiFi Environment

Radar Human Activity Recognition with an Attention-Based Deep Learning Network

Lightweight Transformers for Human Activity Recognition on Mobile Devices

Noninvasive Human Activity Recognition Using Millimeter-Wave Radar

Multi-Classification Algorithm for Human Motion Recognition Based on IR-UWB Radar

Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

Human Activity Recognition Based on Mixed CNN With Radar Multi-Spectrogram

Doppler Radar-Based Human Speech Recognition Using Mobile Vision Transformer

Multi-Task Learning Radar Transformer (MLRT): A Personal Identification and Fall Detection Network Based on IR-UWB Radar

Large Receptive Field Attention: An Innovation in Decomposing Large-Kernel Convolution for Sensor-Based Activity Recognition

Sparsity-based Human Activity Recognition with PointNet using a Portable FMCW Radar

ViT-ReT: Vision and Recurrent Transformer Neural Networks for Human Activity Recognition in Videos

WiTransformer: A Novel Robust Gesture Recognition Sensing Model with WiFi