Abstract:Sensor-based Human Activity Recognition facilitates unobtrusive monitoring of human movements. However, determining the most effective sensor placement for optimal classification performance remains challenging. This paper introduces a novel methodology to resolve this issue, using real-time 2D pose estimations derived from video recordings of target activities. The derived skeleton data provides a unique strategy for identifying the optimal sensor location. We validate our approach through a feasibility study, applying inertial sensors to monitor 13 different activities across ten subjects. Our findings indicate that the vision-based method for sensor placement offers comparable results to the conventional deep learning approach, demonstrating its efficacy. This research significantly advances the field of Human Activity Recognition by providing a lightweight, on-device solution for determining the optimal sensor placement, thereby enhancing data anonymization and supporting a multimodal classification approach.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve two main problems in sensor - based human activity recognition (HAR): 1. **Optimal sensor placement**: - In sensor - based human activity recognition, the placement of sensors directly affects the classification performance. Selecting the optimal sensor placement is a challenge because different placement positions can significantly affect the quality of data and classification results. - The paper proposes a novel method that uses real - time 2D pose estimation to determine the optimal sensor placement. By extracting skeleton data from video recordings, this method can recommend the most effective sensor placement. 2. **Privacy protection**: - When performing human activity recognition, it is usually necessary to use a camera to record videos, which may raise privacy issues, especially in sensitive environments. - The method proposed in the paper creates a skeleton representation of the subject's movement by converting video data into real - time 2D pose estimation, thereby achieving activity recognition without exposing personal identity information and enhancing data anonymization. ### Specific content - **Method overview**: This method uses video data to generate real - time 2D pose estimates, which are not only used to guide optimal sensor placement but also support multimodal classification and improve classification accuracy. - **Experimental verification**: The research team monitored 13 types of care activities of 10 subjects through laboratory research to verify the effectiveness of this method. The results show that this method performs comparably to traditional deep - learning models (such as CNN - LSTM) and is even better in some cases. - **Contributions**: - A lightweight, device - side solution is proposed that can determine the optimal sensor placement without using actual IMU sensors. - Privacy protection is enhanced through 2D pose estimation, while multimodal classification is supported and classification accuracy is improved. ### Summary By introducing a method based on real - time 2D pose estimation, this paper solves the two key problems of sensor placement optimization and privacy protection, providing new ideas and technical means for the field of sensor - based human activity recognition.

A Real-time Human Pose Estimation Approach for Optimal Sensor Placement in Sensor-based Human Activity Recognition

Simultaneous Learning from Human Pose and Object Cues for Real-Time Activity Recognition

Sensor Data Augmentation from Skeleton Pose Sequences for Improving Human Activity Recognition

Hybrid 3D Human Pose Estimation with Monocular Video and Sparse IMUs

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

Training Data Selection and Optimal Sensor Placement for Deep-Learning-Based Sparse Inertial Sensor Human Posture Reconstruction

Human Pose Detection for Robotic-Assisted and Rehabilitation Environments

A novel approach for simultaneous human activity recognition and pose estimation via skeleton-based leveraging WiFi CSI with YOLOv8 and mediapipe frameworks

3D Human Pose Estimation Based on Wearable IMUs and Multiple Camera Views

A Wearable Sensor Network With Embedded Machine Learning for Real-Time Motion Analysis and Complex Posture Detection

Real-Time Human Pose Estimation on a Smart Walker using Convolutional Neural Networks

Design Space Exploration on Efficient and Accurate Human Pose Estimation from Sparse IMU-Sensing

Occlusion-Robust Multi-Sensory Posture Estimation in Physical Human-Robot Interaction

Human Activity Recognition by Sequences of Skeleton Features

Real-time human pose recognition in parts from single depth images

Upper Body Pose Estimation Using Wearable Inertial Sensors and Multiplicative Kalman Filter

Anytime, Anywhere: Human Arm Pose from Smartwatch Data for Ubiquitous Robot Control and Teleoperation

On the Evaluation of Diverse Vision Systems towards Detecting Human Pose in Collaborative Robot Applications

Assessing Cutaneous Psoriasis Activity Using FDG-PET: Nonattenuation Corrected Versus Attenuation Corrected PET Images.

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging

Fall Detection and Activity Recognition Using Human Skeleton Features