Abstract:Human activity recognition (HAR) plays a crucial role in human-computer interaction, smart home, health monitoring and elderly care. However, existing methods typically utilize camera, radio frequency (RF) signals or wearable devices for activity recognition. Each single-sensor modality has its inherent limitations, like camera-based methods having blind spots, Wi-Fi-based methods depending on the environment and the inconvenience of wearing Inertial Measurement Unit (IMU) devices. In this paper, we propose a HAR system that leverages three types of sensor combinations: Wi-Fi, IMU and a hybrid of Wi-Fi+IMU. We utilize the Channel State Information (CSI) provided by Wi-Fi and the accelerometer and gyroscope data from IMU devices to capture activity characteristics. Then, we employ six machine learning algorithms to recognize eight types of daily activities. These algorithms include Support Vector Machine (SVM), Multi-layer Perceptron (MLP), Decision Tree, Random Forest, Logistic Regression and k-Nearest Neighbors (kNN). Additionally, we investigate the accuracy of hand gesture recognition using different sensor combinations and analyze the calculation speed of each combination. We conduct a survey to collect user feedback on the performance of various sensor combinations in our HAR system. The results show that the combination of CSI+IMU yields the best HAR recognition accuracy, with a accuracy of 89.38%. The SVM algorithm consistently performs well across all systems, especially excelling in the CSI+IMU system supported by energy and average Fast Fourier Transform (FFT) features. However, we also find that the success of sensor fusion depends on specific algorithms and features. Fusion of CSI and IMU does not universally enhance recognition accuracy for all features and algorithms and can, in some cases, actually reduce accuracy.

Towards Multi-Classification of Human Motions Using Micro IMU and SVM Training Process

A hybrid HMM/SVM classifier for motion recognition using μIMU data

Towards HMM based human motion recognition using MEMS inertial sensors

Real-time Recognition of Multi-category Human Motion Using Μimu Data

Real-Time Onboard Human Motion Recognition Based On Inertial Measurement Units

An SVM-Based Pedestrian Gait Recognition Algorithm Using a Foot-Mounted IMU

PCA/ICA-based SVM for Fall Recognition Using MEMS Motion Sensing Data.

Multi-Classification Algorithm for Human Motion Recognition Based on IR-UWB Radar

HMM-based IMU Data Processing for Arm Gesture Classification and Motion Tracking

SVM based Multiclass Classifier for Gait phase Classification using Shank IMU Sensor

IMU-based Modularized Wearable Device for Human Motion Classification

IMU-Based Gait Phase Recognition for Stroke Survivors

Gesture Recognition with a 3-D Accelerometer

Machine Learning-Based Human Motion Recognition via Wearable plastic Fiber Sensing System

An Examination of Wearable Sensors and Video Data Capture for Human Exercise Classification

Detection of Human Body Movement Patterns Using IMU and Barometer

Gait Recognition for Human Identification Based on Ica and Fuzzy Svm Through Multiple Views Fusion

Wi-Motion: A Robust Human Activity Recognition Using WiFi Signals

A Multi-Layer Classifier Model XR-KS of Human Activity Recognition for the Problem of Similar Human Activity

Human Activity Recognition via Wi-Fi and Inertial Sensors With Machine Learning

Action recognition for sports combined training based on wearable sensor technology and SVM prediction