Abstract:Behavior recognition technologies based on sensor devices show strong development potential as sensor devices are increasingly applied in people’s lives. However, some challenges in sensor-based behavior recognition, such as incomplete feature extraction, complex behavior recognition algorithms, and the recognition accuracy, remain open issues. To address these issues, this article proposes an improved deep convolutional long short-term memory (DeepConvLSTM) model that uses the squeeze and excitation (SE) module and group convolutions to perform human activity recognition (HAR). The proposed scheme uses convolutional neural network (CNN) and LSTM to simultaneously extract temporal and spatial features. The SE module is an attention mechanism that allows the network to perform feature recalibration, through which the network learns to use global information to selectively emphasize informative features while suppressing less useful features. Moreover, the model uses group convolutions to optimize the number of parameters and reduce the computational complexity. To show the benefit of the proposed model, the performance and efficiency of the improved DeepConvLSTM model and other traditional models are compared on the OPPORTUNITY dataset. In addition, this article evaluates the impact of hyperparameters on the proposed model and designs an ablation experiment to verify the improvement of each modification. The evaluation results show that the improved DeepConvLSTM model increases the HAR accuracy up to 90.80% given that most computational resources are assigned to more informative features. Moreover, floating-point operations per second (FLOPs) are reduced by 88.93% when the number of group is set to 16 because the group convolution reduces the training parameters greatly.

Hierarchical Multi-Scale Adaptive Conv-LSTM Network for Human Action Recognition Based on Wearable Sensors.

Human Action Recognition Based on Hierarchical Multi-Scale Adaptive Conv-Long Short-Term Memory Network

Attention-based LSTM Network for Wearable Human Activity Recognition

Human Activity Recognition Based on Wearable Sensor Using Hierarchical Deep LSTM Networks

Multi-STMT: Multi-Level Network for Human Activity Recognition Based on Wearable Sensors

Human Action Recognition From Digital Videos Based on Deep Learning.

Multiscale Deep Feature Learning for Human Activity Recognition Using Wearable Sensors

Learning Multi-Level Features for Sensor-Based Human Action Recognition.

Hybrid convolution neural network with channel attention mechanism for sensor-based human activity recognition

GraphConvLSTM: Spatiotemporal Learning for Activity Recognition with Wearable Sensors.

Hierarchical Multi-scale Attention Networks for Action Recognition

An Improved Deep Convolutional LSTM for Human Activity Recognition Using Wearable Sensors

Human Action Recognition Based on Selected Spatio-Temporal Features Via Bidirectional LSTM

Bi-direction Hierarchical LSTM with Spatial-Temporal Attention for Action Recognition

A Multi-dimensional Parallel Convolutional Connected Network Based on Multi-source and Multi-modal Sensor Data for Human Activity Recognition

An End to End Framework with Adaptive Spatio-Temporal Attention Module for Human Action Recognition.

Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors

DB-LSTM: Densely-connected Bi-directional LSTM for Human Action Recognition

Sequential Human Activity Recognition Based on Deep Convolutional Network and Extreme Learning Machine Using Wearable Sensors

A Human Action Recognition Model Inspired By Multiple Scale Temporal Segments Model Fusion

An attention-based spatial-temporal hierarchical ConvLSTM network for action recognition in videos