Abstract:Robust and accurate human activity recognition (HAR) systems are essential to many human-centric services within active assisted living and healthcare facilities. Traditional HAR systems mostly leverage a single sensing modality (e.g., either wearable, vision, or radio frequency sensing) combined with machine learning techniques to recognize human activities. Such unimodal HAR systems do not cope well with real-time changes in the environment. To overcome this limitation, new HAR systems that incorporate multiple sensing modalities are needed. Multiple diverse sensors can provide more accurate and complete information resulting in better recognition of the performed activities. This article presents WiWeHAR—a multimodal HAR system that uses combined Wi-Fi and wearable sensing modalities to simultaneously sense the performed activities. WiWeHAR makes use of standard Wi-Fi network interface cards to collect the channel state information (CSI) and a wearable inertial measurement unit (IMU) consisting of accelerometer, gyroscope, magnetometer sensors to collect the user's local body movements. We compute the time-variant mean Doppler shift (MDS) from the processed CSI data and magnitude from the inertial data for each sensor of the IMU. Thereafter, we separately extract various time- and frequency-domain features from the magnitude data and the MDS. We apply feature-level fusion to combine the extracted features, and finally supervised learning techniques are used to recognize the performed activities. We evaluate the performance of WiWeHAR by using a multimodal human activity data set, which was obtained from 9 participants. Each participant carried out four activities, such as walking, falling, sitting, and picking up an object from the floor. Our results indicate that the proposed multimodal WiWeHAR system outperforms the unimodal CSI, accelerometer, gyroscope, and magnetometer HAR systems and achieves an overall recognition acc-racy of 99.6%–100%.

WMS: Wearables-Based Multi-Sensor System for In-home Fitness Guidance

Posture Tracking Meets Fitness Coaching: A Two-Phase Optimization Approach with Wearable Devices

WMNN: Wearables-Based Multi-Column Neural Network for Human Activity Recognition

A Wearable Activity Recognition Device Using Air-Pressure and IMU Sensors.

Automated Patient Handling Activity Recognition for At-Risk Caregivers Using an Unobtrusive Wearable Sensor

Classifying Tasks Performed by Electrical Line Workers Using a Wrist-Worn Sensor: A Data Analytic Approach

Integrated Sensing and Computing for Wearable Human Activity Recognition with MEMS IMU and BLE Network

Automatic Identification and Visualization of Group Training Activities Using Wearable Data

Personalized Human Activity Recognition Based on Integrated Wearable Sensor and Transfer Learning.

Wireless Aerobic Exercise Monitoring System Based on Multimodal Sensors

Wearable Leg Movement Monitoring System for High-Precision Real-Time Metabolic Energy Estimation and Motion Recognition

Real-Time Physical Activity Classification And Tracking Using Wearble Sensors

Real-Time Sensor-Based Human Activity Recognition for eFitness and eHealth Platforms

Accurate Human Activity Recognition with Multi-Task Learning

Device-free Personalized Fitness Assistant Using WiFi

Research on the Human Motion Recognition Method Based on Wearable

Wearable Multi-Sensor Data Fusion Approach for Human Activity Recognition Using Machine Learning Algorithms

WiWeHAR: Multimodal Human Activity Recognition Using Wi-Fi and Wearable Sensing Modalities

Development of Wearable Devices for Collecting Digital Rehabilitation/Fitness Data from Lower Limbs

Human Activity Recognition via Wi-Fi and Inertial Sensors With Machine Learning

Control Your Home with a Smartwatch