Abstract:Human activity recognition (HAR) has emerged as a significant area of research due to its numerous possible applications, including ambient assisted living, healthcare, abnormal behaviour detection, etc. Recently, HAR using WiFi channel state information (CSI) has become a predominant and unique approach in indoor environments compared to others (i.e., sensor and vision) due to its privacy-preserving qualities, thereby eliminating the need to carry additional devices and providing flexibility of capture motions in both line-of-sight (LOS) and non-line-of-sight (NLOS) settings. Existing deep learning (DL)-based HAR approaches usually extract either temporal or spatial features and lack adequate means to integrate and utilize the two simultaneously, making it challenging to recognize different activities accurately. Motivated by this, we propose a novel DL-based model named spatio-temporal convolution with nested long short-term memory (STC-NLSTMNet), with the ability to extract spatial and temporal features concurrently and automatically recognize human activity with very high accuracy. The proposed STC-NLSTMNet model is mainly comprised of depthwise separable convolution (DS-Conv) blocks, feature attention module (FAM) and NLSTM. The DS-Conv blocks extract the spatial features from the CSI signal and add feature attention modules (FAM) to draw attention to the most essential features. These robust features are fed into NLSTM as inputs to explore the hidden intrinsic temporal features in CSI signals. The proposed STC-NLSTMNet model is evaluated using two publicly available datasets: Multi-environment and StanWiFi. The experimental results revealed that the STC-NLSTMNet model achieved activity recognition accuracies of 98.20% and 99.88% on Multi-environment and StanWiFi datasets, respectively. Its activity recognition performance is also compared with other existing approaches and our proposed STC-NLSTMNet model significantly improves the activity recognition accuracies by 4% and 1.88%, respectively, compared to the best existing method.

An AIoT Framework With Multi-modal Frequency Fusion for WiFi-Based Coarse and Fine Activity Recognition

WiFine: Real-Time Gesture Recognition Using Wi-Fi with Edge Intelligence

Multimodal Fusion-AdaBoost Based Activity Recognition for Smart Home on WiFi Platform

A Framework for Human Activity Recognition Based on WiFi CSI Signal Enhancement

A Wi-Fi Signal-Based Human Activity Recognition Using High-Dimensional Factor Models

Joint Activity Recognition and Indoor Localization with WiFi Fingerprints

Temporal-Frequency Attention-Based Human Activity Recognition Using Commercial WiFi Devices

A Real-time Object Detection for WiFi CSI-based Multiple Human Activity Recognition

CSI-F: A Human Motion Recognition Method Based on Channel-State-Information Signal Feature Fusion

STC-NLSTMNet: An Improved Human Activity Recognition Method Using Convolutional Neural Network with NLSTM from WiFi CSI

WiFi-Based Indoor Human Activity Sensing: A Selective Sensing Strategy and a Multi-Level Feature Fusion Approach

Human Activity Recognition Based on Self-Attention Mechanism in WiFi Environment

An improved Wi-Fi sensing-based human activity recognition using multi-stage deep learning model

Human Activity Recognition via Wi-Fi and Inertial Sensors With Machine Learning

Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognition

A Survey of Human Activity Recognition Using WiFi CSI

A Novel Deep Multifeature Extraction Framework Based on Attention Mechanism Using Wearable Sensor Data for Human Activity Recognition

A Framework of Combining Short-Term Spatial/Frequency Feature Extraction and Long-Term IndRNN for Activity Recognition

MaskFi: Unsupervised Learning of WiFi and Vision Representations for Multimodal Human Activity Recognition

Device-Free Human Activity Recognition Based on Dual-Channel Transformer Using WiFi Signals

Understanding And Modeling Of Wifi Signal Based Human Activity Recognition