Abstract:Capturing time and frequency relationships of time series signals offers an inherent barrier for automatic human activity recognition (HAR) from wearable sensor data. Extracting spatiotemporal context from the feature space of the sensor reading sequence is challenging for the current recurrent, convolutional, or hybrid activity recognition models. The overall classification accuracy also gets affected by large size feature maps that these models generate. To this end, in this work, we have put forth a hybrid architecture for wearable sensor data-based HAR. We initially use Continuous Wavelet Transform to encode the time series of sensor data as multi-channel images. Then, we utilize a Spatial Attention-aided Convolutional Neural Network (CNN) to extract higher-dimensional features. To find the most essential features for recognizing human activities, we develop a novel feature selection (FS) method. In order to identify the fitness of the features for the FS, we first employ three filter-based methods: Mutual Information (MI), Relief-F, and minimum redundancy maximum relevance (mRMR). The best set of features is then chosen by removing the lower-ranked features using a modified version of the Genetic Algorithm (GA). The K-Nearest Neighbors (KNN) classifier is then used to categorize human activities. We conduct comprehensive experiments on five well-known, publicly accessible HAR datasets, namely UCI-HAR, WISDM, MHEALTH, PAMAP2, and HHAR. Our model significantly outperforms the state-of-the-art models in terms of classification performance. We also observe an improvement in overall recognition accuracy with the use of GA-based FS technique with a lower number of features. The source code of the paper is publicly available here https://github.com/apusarkar2195/HAR_WaveletTransform_SpatialAttention_FeatureSelection.

Beyond the Gates of Euclidean Space: Temporal-Discrimination-Fusions and Attention-based Graph Neural Network for Human Activity Recognition

Leveraging spatio-temporal features using graph neural networks for human activity recognition

A Novel Spatio-Temporal Network of Multi-channel CNN and GCN for Human Activity Recognition Based on BAN

GANCDE: Neural networks based on graphs and attention neural control differential equations for human activity recognition

Beyond Isolated Frames: Enhancing Sensor-Based Human Activity Recognition through Intra- and Inter-Frame Attention

HAR-GCNN: Deep Graph CNNs for Human Activity Recognition From Highly Unlabeled Mobile Sensor Data

Deep Transfer Learning with Graph Neural Network for Sensor-Based Human Activity Recognition

Attention-based LSTM Network for Wearable Human Activity Recognition

Using Graphs to Perform Effective Sensor-Based Human Activity Recognition in Smart Homes

Know Thy Neighbors: A Graph Based Approach for Effective Sensor-Based Human Activity Recognition in Smart Homes

Human Activity Recognition Based on Gramian Angular Field and Deep Convolutional Neural Network

Multi-STMT: Multi-Level Network for Human Activity Recognition Based on Wearable Sensors

Attention-Based Deep Learning Framework for Human Activity Recognition with User Adaptation

Improving Human Activity Recognition Via Graph Attention Network with Linear Discriminant Analysis and Residual Learning

Wearable Sensor-Based Residual Multifeature Fusion Shrinkage Networks for Human Activity Recognition

Human activity recognition from sensor data using spatial attention-aided CNN with genetic algorithm

Multihead-Res-SE Residual Network with Attention for Human Activity Recognition

GRU with Dual Attentions for Sensor-Based Human Activity Recognition

A Multi-dimensional Parallel Convolutional Connected Network Based on Multi-source and Multi-modal Sensor Data for Human Activity Recognition

Sensor-Based Human Activity Recognition with Spatio-Temporal Deep Learning

HHAR-net: Hierarchical Human Activity Recognition using Neural Networks