Abstract:Human activity recognition (HAR) has emerged as a significant area of research due to its numerous possible applications, including ambient assisted living, healthcare, abnormal behaviour detection, etc. Recently, HAR using WiFi channel state information (CSI) has become a predominant and unique approach in indoor environments compared to others (i.e., sensor and vision) due to its privacy-preserving qualities, thereby eliminating the need to carry additional devices and providing flexibility of capture motions in both line-of-sight (LOS) and non-line-of-sight (NLOS) settings. Existing deep learning (DL)-based HAR approaches usually extract either temporal or spatial features and lack adequate means to integrate and utilize the two simultaneously, making it challenging to recognize different activities accurately. Motivated by this, we propose a novel DL-based model named spatio-temporal convolution with nested long short-term memory (STC-NLSTMNet), with the ability to extract spatial and temporal features concurrently and automatically recognize human activity with very high accuracy. The proposed STC-NLSTMNet model is mainly comprised of depthwise separable convolution (DS-Conv) blocks, feature attention module (FAM) and NLSTM. The DS-Conv blocks extract the spatial features from the CSI signal and add feature attention modules (FAM) to draw attention to the most essential features. These robust features are fed into NLSTM as inputs to explore the hidden intrinsic temporal features in CSI signals. The proposed STC-NLSTMNet model is evaluated using two publicly available datasets: Multi-environment and StanWiFi. The experimental results revealed that the STC-NLSTMNet model achieved activity recognition accuracies of 98.20% and 99.88% on Multi-environment and StanWiFi datasets, respectively. Its activity recognition performance is also compared with other existing approaches and our proposed STC-NLSTMNet model significantly improves the activity recognition accuracies by 4% and 1.88%, respectively, compared to the best existing method.

Towards CSI-based diversity activity recognition via LSTM-CNN encoder-decoder neural network

Encoding Learning Network Combined with Feature Similarity Constraints for Human Action Recognition

Lstm With Uniqueness Attention For Human Activity Recognition

WiFi Sensing for Drastic Activity Recognition with CNN-BiLSTM Architecture.

Human Activity Recognition based on WiFi Signal Using Deep Neural Network

Device-free Location-independent Human Activity Recognition using Transfer Learning based on CNN

An improved Wi-Fi sensing-based human activity recognition using multi-stage deep learning model

A Survey of Human Activity Recognition Using WiFi CSI

Location- and Person-Independent Activity Recognition with WiFi, Deep Neural Networks, and Reinforcement Learning

Simultaneous Implementation Features Extraction and Recognition Using C3D Network for WiFi-based Human Activity Recognition

Environment-Robust Device-Free Human Activity Recognition With Channel-State-Information Enhancement and One-Shot Learning

Location-Free Csi Based Activity Recognition With Angle Difference Of Arrival

A Real-time Object Detection for WiFi CSI-based Multiple Human Activity Recognition

Human Activity Recognition Based on Self-Attention Mechanism in WiFi Environment

Towards Environment-Independent Activity Recognition Using Wi-Fi CSI with an Encoder-Decoder Network

STC-NLSTMNet: An Improved Human Activity Recognition Method Using Convolutional Neural Network with NLSTM from WiFi CSI

A Framework for Human Activity Recognition Based on WiFi CSI Signal Enhancement

Temporal-Frequency Attention-Based Human Activity Recognition Using Commercial WiFi Devices

A Deep Learning Based Lightweight Human Activity Recognition System Using Reconstructed WiFi CSI

Skeleton-based human activity recognition with wifi CSI using a hybrid approach combining convolutional neural network and long short term memory

Joint Activity Recognition and Indoor Localization with WiFi Fingerprints