Abstract:Vision-based human activity recognition (HAR) has emerged as one of the essential research areas in video analytics. Over the last decade, numerous advanced deep learning algorithms have been introduced to recognize complex human actions from video streams. These deep learning algorithms have shown impressive performance for the video analytics task. However, these newly introduced methods either exclusively focus on model performance or the effectiveness of these models in terms of computational efficiency, resulting in a biased trade-off between robustness and computational efficiency in their proposed methods to deal with challenging HAR problem. To enhance both the accuracy and computational efficiency, this paper presents a computationally efficient yet generic spatial–temporal cascaded framework that exploits the deep discriminative spatial and temporal features for HAR. For efficient representation of human actions, we propose an efficient dual attentional convolutional neural network (DA-CNN) architecture that leverages a unified channel–spatial attention mechanism to extract human-centric salient features in video frames. The dual channel–spatial attention layers together with the convolutional layers learn to be more selective in the spatial receptive fields having objects within the feature maps. The extracted discriminative salient features are then forwarded to a stacked bi-directional gated recurrent unit (Bi-GRU) for long-term temporal modeling and recognition of human actions using both forward and backward pass gradient learning. Extensive experiments are conducted on three publicly available human action datasets, where the obtained results verify the effectiveness of our proposed framework (DA-CNN+Bi-GRU) over the state-of-the-art methods in terms of model accuracy and inference runtime across each dataset. Experimental results show that the DA-CNN+Bi-GRU framework attains an improvement in execution time up to 167× in terms of frames per second as compared to most of the contemporary action-recognition methods.

GRU with Dual Attentions for Sensor-Based Human Activity Recognition

Lstm With Uniqueness Attention For Human Activity Recognition

A Novel Deep Learning Bi-GRU-I Model for Real-Time Human Activity Recognition Using Inertial Sensors

Attention-based LSTM Network for Wearable Human Activity Recognition

Multihead-Res-SE Residual Network with Attention for Human Activity Recognition

Deep Bidirectional GRU network for human activity recognition using Wearable inertial sensors

DanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensors

Multi-STMT: Multi-Level Network for Human Activity Recognition Based on Wearable Sensors

Human Activity Recognition Based on Gramian Angular Field and Deep Convolutional Neural Network

A Robust Real-time Human Activity Recognition Method Based on Attention-Augmented GRU

Innovative Dual-Decoupling CNN with Layer-wise Temporal-Spatial Attention for Sensor-Based Human Activity Recognition

Inception inspired CNN-GRU hybrid network for human activity recognition

Recognition of human activity using GRU deep learning algorithm

Transformer With Bidirectional GRU for Nonintrusive, Sensor-Based Activity Recognition in a Multiresident Environment

Beyond the Gates of Euclidean Space: Temporal-Discrimination-Fusions and Attention-based Graph Neural Network for Human Activity Recognition

A Dual Pipeline with Spatio-Temporal Attention Fusion Approach for Human Activity Recognition

Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors

A Novel CNN-BiLSTM-GRU Hybrid Deep Learning Model for Human Activity Recognition

CapsGaNet: Deep Neural Network Based on Capsule and GRU for Human Activity Recognition

Residual deep gated recurrent unit-based attention framework for human activity recognition by exploiting dilated features

Human Activity Recognition Using Cascaded Dual Attention CNN and Bi-Directional GRU Framework