Abstract:Capturing time and frequency relationships of time series signals offers an inherent barrier for automatic human activity recognition (HAR) from wearable sensor data. Extracting spatiotemporal context from the feature space of the sensor reading sequence is challenging for the current recurrent, convolutional, or hybrid activity recognition models. The overall classification accuracy also gets affected by large size feature maps that these models generate. To this end, in this work, we have put forth a hybrid architecture for wearable sensor data-based HAR. We initially use Continuous Wavelet Transform to encode the time series of sensor data as multi-channel images. Then, we utilize a Spatial Attention-aided Convolutional Neural Network (CNN) to extract higher-dimensional features. To find the most essential features for recognizing human activities, we develop a novel feature selection (FS) method. In order to identify the fitness of the features for the FS, we first employ three filter-based methods: Mutual Information (MI), Relief-F, and minimum redundancy maximum relevance (mRMR). The best set of features is then chosen by removing the lower-ranked features using a modified version of the Genetic Algorithm (GA). The K-Nearest Neighbors (KNN) classifier is then used to categorize human activities. We conduct comprehensive experiments on five well-known, publicly accessible HAR datasets, namely UCI-HAR, WISDM, MHEALTH, PAMAP2, and HHAR. Our model significantly outperforms the state-of-the-art models in terms of classification performance. We also observe an improvement in overall recognition accuracy with the use of GA-based FS technique with a lower number of features. The source code of the paper is publicly available here https://github.com/apusarkar2195/HAR_WaveletTransform_SpatialAttention_FeatureSelection.

Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks

Efficient human activity recognition with spatio-temporal spiking neural networks

Attention-based LSTM Network for Wearable Human Activity Recognition

Sensor-Based Human Activity Recognition with Spatio-Temporal Deep Learning

Human activity recognition from sensor data using spatial attention-aided CNN with genetic algorithm

Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearables

Temporal-Spatial Dynamic Convolutional Neural Network for Human Activity Recognition Using Wearable Sensors

Spike-HAR++: an Energy-Efficient and Lightweight Parallel Spiking Transformer for Event-Based Human Action Recognition

HAR-Net:Fusing Deep Representation and Hand-crafted Features for Human Activity Recognition

Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors

Beyond the Gates of Euclidean Space: Temporal-Discrimination-Fusions and Attention-based Graph Neural Network for Human Activity Recognition

Wearable Sensor-Based Residual Multifeature Fusion Shrinkage Networks for Human Activity Recognition

Multi-STMT: Multi-Level Network for Human Activity Recognition Based on Wearable Sensors

A Novel CNN-BiLSTM-GRU Hybrid Deep Learning Model for Human Activity Recognition

Deep Convolutional Neural Network with RNNs for Complex Activity Recognition Using Wrist-Worn Wearable Sensor Data

A Novel Spatio-Temporal Network of Multi-channel CNN and GCN for Human Activity Recognition Based on BAN

A Novel Deep Learning Bi-GRU-I Model for Real-Time Human Activity Recognition Using Inertial Sensors

Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition

SparseSense: Human Activity Recognition from Highly Sparse Sensor Data-streams Using Set-based Neural Networks

Deep learning based human activity recognition (HAR) using wearable sensor data

RF-Based Human Activity Recognition Using Signal Adapted Convolutional Neural Network