Abstract:Behavior analysis through posture recognition is an essential research in robotic systems. Sitting with unhealthy sitting posture for a long time seriously harms human health and may even lead to lumbar disease, cervical disease and myopia. Automatic vision-based detection of unhealthy sitting posture, as an example of posture detection in robotic systems, has become a hot research topic. However, the existing methods only focus on extracting features of human themselves and lack understanding relevancies among objects in the scene, and henceforth fail to recognize some types of unhealthy sitting postures in complicated environments. To alleviate these problems, a scene recognition and semantic analysis approach to unhealthy sitting posture detection in screen-reading is proposed in this paper. The key skeletal points of human body are detected and tracked with a Microsoft Kinect sensor. Meanwhile, a deep learning method, Faster R-CNN, is used in the scene recognition of our method to accurately detect objects and extract relevant features. Then our method performs semantic analysis through Gaussian-Mixture behavioral clustering for scene understanding. The relevant features in the scene and the skeletal features extracted from human are fused into the semantic features to discriminate various types of sitting postures. Experimental results demonstrated that our method accurately and effectively detected various types of unhealthy sitting postures in screen-reading and avoided error detection in complicated environments. Compared with the existing methods, our proposed method detected more types of unhealthy sitting postures including those that the existing methods could not detect. Our method can be potentially applied and integrated as a medical assistance in robotic systems of health care and treatment.

Vision-based Postural Risk Auto-assessment Method for Sit-stand Office Working Using REBA

Healthy Human Sitting Posture Estimation in RGB-D Scenes Using Object Context

SmartSit: Sitting Posture Recognition Through Acoustic Sensing on Smartphones

Improved REBA: deep learning based rapid entire body risk assessment for prevention of musculoskeletal disorders

An Evaluation of Posture Recognition Based on Intelligent Rapid Entire Body Assessment System for Determining Musculoskeletal Disorders

A Privacy-Preserving and Unobtrusive Sitting Posture Recognition System Via Pressure Array Sensor and Infrared Array Sensor for Office Workers

Automated Kinect-based posture evaluation method for work-related musculoskeletal disorders of construction workers

Design of an Ergonomic App for Entire Rapid Body Assessment Based on Mask RCNN

SEE: A proactive strategy-centric and deep learning-based ergonomic risk assessment system for risky posture recognition

Multimodal Data-Based Deep Learning Model for Sitting Posture Recognition Toward Office Workers’ Health Promotion

Real-Time Posture Monitoring and Risk Assessment for Manual Lifting Tasks Using MediaPipe and LSTM

A Scene Recognition and Semantic Analysis Approach to Unhealthy Sitting Posture Detection during Screen-Reading

A computer vision based method for 3D posture estimation of symmetrical lifting.

A Systematic Review: Advancing Ergonomic Posture Risk Assessment Through the Integration of Computer Vision and Machine Learning Techniques

Are You Sitting Right?-Sitting Posture Recognition Using RF Signals

Joint-Level Vision-Based Ergonomic Assessment Tool for Construction Workers

Posture Risk Assessment in an Automotive Assembly Line Using Inertial Sensors

Monocular 3D Multi-Person Pose Estimation for On-Site Joint Flexion Assessment: A Case of Extreme Knee Flexion Detection

RGBD-Based Real-Time 3D Human Pose Estimation for Fitness Assessment

An ergonomic evaluation using a deep learning approach for assessing postural risks in a virtual reality-based smart manufacturing context

Posture Monitoring and Correction Exercises for Workers in Hostile Environments Utilizing Non-Invasive Sensors: Algorithm Development and Validation