Abstract:Behavior recognition technologies based on sensor devices show strong development potential as sensor devices are increasingly applied in people’s lives. However, some challenges in sensor-based behavior recognition, such as incomplete feature extraction, complex behavior recognition algorithms, and the recognition accuracy, remain open issues. To address these issues, this article proposes an improved deep convolutional long short-term memory (DeepConvLSTM) model that uses the squeeze and excitation (SE) module and group convolutions to perform human activity recognition (HAR). The proposed scheme uses convolutional neural network (CNN) and LSTM to simultaneously extract temporal and spatial features. The SE module is an attention mechanism that allows the network to perform feature recalibration, through which the network learns to use global information to selectively emphasize informative features while suppressing less useful features. Moreover, the model uses group convolutions to optimize the number of parameters and reduce the computational complexity. To show the benefit of the proposed model, the performance and efficiency of the improved DeepConvLSTM model and other traditional models are compared on the OPPORTUNITY dataset. In addition, this article evaluates the impact of hyperparameters on the proposed model and designs an ablation experiment to verify the improvement of each modification. The evaluation results show that the improved DeepConvLSTM model increases the HAR accuracy up to 90.80% given that most computational resources are assigned to more informative features. Moreover, floating-point operations per second (FLOPs) are reduced by 88.93% when the number of group is set to 16 because the group convolution reduces the training parameters greatly.

GraphConvLSTM: Spatiotemporal Learning for Activity Recognition with Wearable Sensors.

Attention-based LSTM Network for Wearable Human Activity Recognition

Graph-Temporal LSTM Networks for Skeleton-Based Action Recognition

An Improved Deep Convolutional LSTM for Human Activity Recognition Using Wearable Sensors

Hierarchical Multi-Scale Adaptive Conv-LSTM Network for Human Action Recognition Based on Wearable Sensors.

Human Activity Recognition Based on Wearable Sensor Using Hierarchical Deep LSTM Networks

Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition

Deep Residual Bidir-LSTM for Human Activity Recognition Using Wearable Sensors

Enhancing human behavior recognition with spatiotemporal graph convolutional neural networks and skeleton sequences

Sensor-based Human Activity Recognition Using Graph LSTM and Multi-task Classification Model

An Attentional Spatial Temporal Graph Convolutional Network with Co-Occurrence Feature Learning for Action Recognition

Sequential Human Activity Recognition Based on Deep Convolutional Network and Extreme Learning Machine Using Wearable Sensors

A Spatio-temporal Graph Transformer Driven Model for Recognizing Fine-Grained Data Human Activity

Ensembles of Deep LSTM Learners for Activity Recognition using Wearables

Deep Transfer Learning with Graph Neural Network for Sensor-Based Human Activity Recognition

Short-Time Activity Recognition With Wearable Sensors Using Convolutional Neural Network

A Boundary Consistency-aware Multi-task Learning Framework for Joint Activity Segmentation and Recognition with Wearable Sensors

Temporal-Spatial Dynamic Convolutional Neural Network for Human Activity Recognition Using Wearable Sensors

Deep ConvLSTM With Self-Attention for Human Activity Decoding Using Wearable Sensors

Multi-STMT: Multi-Level Network for Human Activity Recognition Based on Wearable Sensors

Human Action Recognition Based on Hierarchical Multi-Scale Adaptive Conv-Long Short-Term Memory Network