Abstract:Human activity recognition (HAR) has emerged as a significant area of research due to its numerous possible applications, including ambient assisted living, healthcare, abnormal behaviour detection, etc. Recently, HAR using WiFi channel state information (CSI) has become a predominant and unique approach in indoor environments compared to others (i.e., sensor and vision) due to its privacy-preserving qualities, thereby eliminating the need to carry additional devices and providing flexibility of capture motions in both line-of-sight (LOS) and non-line-of-sight (NLOS) settings. Existing deep learning (DL)-based HAR approaches usually extract either temporal or spatial features and lack adequate means to integrate and utilize the two simultaneously, making it challenging to recognize different activities accurately. Motivated by this, we propose a novel DL-based model named spatio-temporal convolution with nested long short-term memory (STC-NLSTMNet), with the ability to extract spatial and temporal features concurrently and automatically recognize human activity with very high accuracy. The proposed STC-NLSTMNet model is mainly comprised of depthwise separable convolution (DS-Conv) blocks, feature attention module (FAM) and NLSTM. The DS-Conv blocks extract the spatial features from the CSI signal and add feature attention modules (FAM) to draw attention to the most essential features. These robust features are fed into NLSTM as inputs to explore the hidden intrinsic temporal features in CSI signals. The proposed STC-NLSTMNet model is evaluated using two publicly available datasets: Multi-environment and StanWiFi. The experimental results revealed that the STC-NLSTMNet model achieved activity recognition accuracies of 98.20% and 99.88% on Multi-environment and StanWiFi datasets, respectively. Its activity recognition performance is also compared with other existing approaches and our proposed STC-NLSTMNet model significantly improves the activity recognition accuracies by 4% and 1.88%, respectively, compared to the best existing method.

Enhanced federated recognition mechanism based on spatial-temporal model with split learning for multi-view human activity classification in edge intelligent network

Cloud-Edge Collaborative Human Activity Recognition System Design and Implementation.

Multi-STMT: Multi-Level Network for Human Activity Recognition Based on Wearable Sensors

STC-NLSTMNet: An Improved Human Activity Recognition Method Using Convolutional Neural Network with NLSTM from WiFi CSI

Deep Learning for Heterogeneous Human Activity Recognition in Complex IoT Applications

Sensor-Based Human Activity Recognition with Spatio-Temporal Deep Learning

A multi-scale feature extraction fusion model for human activity recognition

Personalized human activity recognition using deep learning and edge-cloud architecture

Multiscale Deep Feature Learning for Human Activity Recognition Using Wearable Sensors

Innovative Dual-Decoupling CNN with Layer-wise Temporal-Spatial Attention for Sensor-Based Human Activity Recognition

A federated learning system with enhanced feature extraction for human activity recognition

Multi-level Contrast Network for Wearables-based Joint Activity Segmentation and Recognition.

Dual-Branch Interactive Networks on Multichannel Time Series for Human Activity Recognition

Wearable Sensor-Based Residual Multifeature Fusion Shrinkage Networks for Human Activity Recognition

HAR-DeepConvLG: Hybrid Deep Learning-Based Model for Human Activity Recognition in IoT Applications.

Multi-Sensor Data Fusion and CNN-LSTM Model for Human Activity Recognition System

A Class Incremental Temporal-Spatial Model Based on Wireless Sensor Networks for Activity Recognition.

Human Activity Recognition via Temporal Fusion Contrastive Learning

1-DCNN with Stacked LSTM Architecture for Human Activity Recognition Using Wearable Sensing Data

A spatiotemporal multi-feature extraction framework with space and channel based squeeze-and-excitation blocks for human activity recognition

Robust CSI-Based Human Activity Recognition With Augment Few Shot Learning