Abstract:In factories, human posture recognition facilitates human–machine collaboration, human risk management, and workflow improvement. Compared to optical sensors, inertial sensors have the advantages of portability and resistance to obstruction, making them suitable for factories. However, existing product-level inertial sensing solutions are generally expensive. This paper proposes a low-cost human motion capture system based on BMI 160, a type of six-axis inertial measurement unit (IMU). Based on WIFI communication, the collected data are processed to obtain the displacement of human joints' rotation angles around XYZ directions and the displacement in XYZ directions, then the human skeleton hierarchical relationship was combined to calculate the real-time human posture. Furthermore, the digital human model was been established on Unity3D to synchronously visualize and present human movements. We simulated assembly operations in a virtual reality environment for human posture data collection and posture recognition experiments. Six inertial sensors were placed on the chest, waist, knee joints, and ankle joints of both legs. There were 16,067 labeled samples obtained for posture recognition model training, and the accumulated displacement and the rotation angle of six joints in the three directions were used as input features. The bi-directional long short-term memory (BiLSTM) model was used to identify seven common operation postures: standing, slightly bending, deep bending, half-squatting, squatting, sitting, and supine, with an average accuracy of 98.24%. According to the experiment result, the proposed method could be used to develop a low-cost and effective solution to human posture recognition for factory operation.

Machine Vision Based Physical Fitness Measurement with Human Posture Recognition and Skeletal Data Smoothing

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

Posture Tracking Meets Fitness Coaching: A Two-Phase Optimization Approach with Wearable Devices

A New Kinect-Based Posture Recognition Method in Physical Sports Training Based on Urban Data

Skeleton-based Human Keypoints Detection and Action Similarity Assessment for Fitness Assistance

Pose Estimation in Physical Human-Machine Interactions with Application to Bicycle Riding

Whole-body Pose Estimation in Physical Rider-Bicycle Interactions with a Monocular Camera and a Set of Wearable Gyroscopes

AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training Assistance

Optimization of Human Posture Recognition based on Multi-view Skeleton Data Fusion

Intelligent Fitness Trainer System Based on Human Pose Estimation

Human posture estimation and action recognition on fitness behavior and fitness

Multiple Kinect based system to monitor and analyze key performance indicators of physical training

Design and Validation of Depth Camera-Based Static Posture Assessment System

A Novel Method for User-Defined Human Posture Recognition Using Kinect

View independent human posture identification using Kinect

RGBD-Based Real-Time 3D Human Pose Estimation for Fitness Assessment

Simulation of machine vision based on light detection sensors in aerobics judgment assistance system

Computer Vision-Driven Evaluation System for Assisted Decision-Making in Sports Training

A Low-Cost Inertial Measurement Unit Motion Capture System for Operation Posture Collection and Recognition

Deeper Exercise Monitoring for Smart Gym using Fused RFID and CV Data

Human Posture Recognition Based on Skeleton Data