Abstract:Human activity recognition (HAR) plays a crucial role in human-computer interaction, smart home, health monitoring and elderly care. However, existing methods typically utilize camera, radio frequency (RF) signals or wearable devices for activity recognition. Each single-sensor modality has its inherent limitations, like camera-based methods having blind spots, Wi-Fi-based methods depending on the environment and the inconvenience of wearing Inertial Measurement Unit (IMU) devices. In this paper, we propose a HAR system that leverages three types of sensor combinations: Wi-Fi, IMU and a hybrid of Wi-Fi+IMU. We utilize the Channel State Information (CSI) provided by Wi-Fi and the accelerometer and gyroscope data from IMU devices to capture activity characteristics. Then, we employ six machine learning algorithms to recognize eight types of daily activities. These algorithms include Support Vector Machine (SVM), Multi-layer Perceptron (MLP), Decision Tree, Random Forest, Logistic Regression and k-Nearest Neighbors (kNN). Additionally, we investigate the accuracy of hand gesture recognition using different sensor combinations and analyze the calculation speed of each combination. We conduct a survey to collect user feedback on the performance of various sensor combinations in our HAR system. The results show that the combination of CSI+IMU yields the best HAR recognition accuracy, with a accuracy of 89.38%. The SVM algorithm consistently performs well across all systems, especially excelling in the CSI+IMU system supported by energy and average Fast Fourier Transform (FFT) features. However, we also find that the success of sensor fusion depends on specific algorithms and features. Fusion of CSI and IMU does not universally enhance recognition accuracy for all features and algorithms and can, in some cases, actually reduce accuracy.

Human activity recognition with user-free accelerometers in the sensor networks

Human Activity Recognition Based on UWB Location System

Human Activity Recognition Based on Triaxial Accelerometer

Wearable Computing for Internet of Things: A Discriminant Approach for Human Activity Recognition

A Triaxial Accelerometer-Based Human Activity Recognition Via EEMD-Based Features and Game-Theory-Based Feature Selection

An Improved Algorithm for Human Activity Recognition Using Wearable Sensors

Design of Human Activity Recognition Algorithms Based on a Single Wearable IMU Sensor.

Strong robustness human activity recognition based on wearable sensors

Recognition of Human Activities with Wearable Sensors

Human Activity Recognition via Wi-Fi and Inertial Sensors With Machine Learning

A Human Activity Recognition Model Based on Wearable Sensor

Human activity recognition by fusing multiple sensor nodes in the wearable sensor systems

A Robust and Device-Free Daily Activities Recognition System using Wi-Fi Signals

The Recognition of Human Daily Actions with Wearable Motion Sensor System

Robust human activity recognition using single accelerometer via wavelet energy spectrum features and ensemble feature selection

Recognizing Multi-User Activities Using Wearable Sensors in a Smart Home

Wearable Multi-Sensor Data Fusion Approach for Human Activity Recognition Using Machine Learning Algorithms

Multi-User Activity Recognition In A Smart Home

Real-Time Physical Activity Classification And Tracking Using Wearble Sensors

Recognition of Human Activities' Signals by Geometric Features

Temporal-Frequency Attention-Based Human Activity Recognition Using Commercial WiFi Devices