Abstract:Inertial signals are the most widely used signals in human activity recognition (HAR) applications, and extensive research has been performed on developing HAR classifiers using accelerometer and gyroscope data. This study aimed to investigate the potential enhancement of HAR models through the fusion of biological signals with inertial signals. The classification of eight common low-, medium-, and high-intensity activities was assessed using machine learning (ML) algorithms, trained on accelerometer (ACC), blood volume pulse (BVP), and electrodermal activity (EDA) data obtained from a wrist-worn sensor. Two types of ML algorithms were employed: a random forest (RF) trained on features; and a pre-trained deep learning (DL) network (ResNet-18) trained on spectrogram images. Evaluation was conducted on both individual activities and more generalized activity groups, based on similar intensity. Results indicated that RF classifiers outperformed corresponding DL classifiers at both individual and grouped levels. However, the fusion of EDA and BVP signals with ACC data improved DL classifier performance compared to a baseline DL model with ACC-only data. The best performance was achieved by a classifier trained on a combination of ACC, EDA, and BVP images, yielding F1-scores of 69 and 87 for individual and grouped activity classifications, respectively. For DL models trained with additional biological signals, almost all individual activity classifications showed improvement (p-value < 0.05). In grouped activity classifications, DL model performance was enhanced for low- and medium-intensity activities. Exploring the classification of two specific activities, ascending/descending stairs and cycling, revealed significantly improved results using a DL model trained on combined ACC, BVP, and EDA spectrogram images (p-value < 0.05).

Comparison of Deep Learning Techniques on Human Activity Recognition using Ankle Inertial Signals

Comparison Study of Inertial Sensor Signal Combination for Human Activity Recognition based on Convolutional Neural Networks

Human Activity Recognition from Knee Angle Using Machine Learning Techniques

A Light-Weight Artificial Neural Network for Recognition of Activities of Daily Living

A Comparative Analysis of Hybrid Deep Learning Models for Human Activity Recognition

Human Activity Recognition with Convolutional Neural Netowrks

Human Activity Recognition Algorithm with Physiological and Inertial Signals Fusion: Photoplethysmography, Electrodermal Activity, and Accelerometry

A Comparative Study on Classifying Human Activities Using Classical Machine and Deep Learning Methods

Human Activity Recognition: A Comparative Study to Assess the Contribution Level of Accelerometer, ECG, and PPG Signals

Human Activity Recognition Based on Wireless Electrocardiogram and Inertial Sensors

A Novel Deep Learning Bi-GRU-I Model for Real-Time Human Activity Recognition Using Inertial Sensors

Human Activity Recognition using Inertial, Physiological and Environmental Sensors: a Comprehensive Survey

DeepHAR: a deep feed-forward neural network algorithm for smart insole-based human activity recognition

HHAR-net: Hierarchical Human Activity Recognition using Neural Networks

A Deep Learning Method for Complex Human Activity Recognition Using Virtual Wearable Sensors

Optimum signal duration for Human Activity Recognition based on Deep Convolutional Neural Networks

A Wearable Inertial Sensor Approach for Locomotion and Localization Recognition on Physical Activity

ActiveHARNet: Towards On-Device Deep Bayesian Active Learning for Human Activity Recognition

Human Activity Prediction Based on Forecasted IMU Activity Signals by Sequence-to-Sequence Deep Neural Networks

Introducing IHARDS-CNN: A Cutting-Edge Deep Learning Method for Human Activity Recognition Using Wearable Sensors

Human activity recognition in cyber-physical systems using optimized machine learning techniques