Abstract:Sensor-based human activity recognition (S-HAR) has become an important and high-impact topic of research within human-centered computing. In the last decade, successful applications of S-HAR have been presented through fruitful academic research and industrial applications, including for healthcare monitoring, smart home controlling, and daily sport tracking. However, the growing requirements of many current applications for recognizing complex human activities (CHA) have begun to attract the attention of the HAR research field when compared with simple human activities (SHA). S-HAR has shown that deep learning (DL), a type of machine learning based on complicated artificial neural networks, has a significant degree of recognition efficiency. Convolutional neural networks (CNNs) and recurrent neural networks (RNNs) are two different types of DL methods that have been successfully applied to the S-HAR challenge in recent years. In this paper, we focused on four RNN-based DL models (LSTMs, BiLSTMs, GRUs, and BiGRUs) that performed complex activity recognition tasks. The efficiency of four hybrid DL models that combine convolutional layers with the efficient RNN-based models was also studied. Experimental studies on the UTwente dataset demonstrated that the suggested hybrid RNN-based models achieved a high level of recognition performance along with a variety of performance indicators, including accuracy, F1-score, and confusion matrix. The experimental results show that the hybrid DL model called CNN-BiGRU outperformed the other DL models with a high accuracy of 98.89% when using only complex activity data. Moreover, the CNN-BiGRU model also achieved the highest recognition performance in other scenarios (99.44% by using only simple activity data and 98.78% with a combination of simple and complex activities).

A Survey on Hand-based Behavioral Activity Recognition

Human Activity Recognition using Deep Learning Models on Smartphones and Smartwatches Sensor Data

Toward Hand-Dominated Activity Recognition Systems With Wristband-Interaction Behavior Analysis

Enhanced Hand-Oriented Activity Recognition Based on Smartwatch Sensor Data Using LSTMs

Recognition of Smoking Gesture Using Smart Watch Technology

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Human Activity Recognition Based on Wireless Electrocardiogram and Inertial Sensors

Control with Gestures: A Hand Gesture Recognition System Using Off-the-Shelf Smartwatch.

SmartHandwriting: Handwritten Chinese Character Recognition with Smartwatch.

Leveraging Sound and Wrist Motion to Detect Activities of Daily Living with Commodity Smartwatches

A Novel PPG-FMG-ACC Wristband for Hand Gesture Recognition

UMAHand: A dataset of inertial signals of typical hand activities

Deep CNN-LSTM With Self-Attention Model for Human Activity Recognition Using Wearable Sensor

Finger Gesture Recognition Using a Smartwatch with Integrated Motion Sensors.

Wearable sensors based on artificial intelligence models for human activity recognition

Deep Neural Networks for Time Series Classification in Human Activity Recognition

Experimental Analysis Of Artificial Neural Networks Performance For Physical Activity Recognition Using Belt And Wristband Devices

Deep Convolutional Neural Network with RNNs for Complex Activity Recognition Using Wrist-Worn Wearable Sensor Data

Innovative healthcare solutions: robust hand gesture recognition of daily life routines using 1D CNN

Deep Residual Network for Smartwatch-Based User Identification through Complex Hand Movements

Multimodal Human Activity Recognition From Wearable Inertial Sensors Using Machine Learning