Abstract:Behavior analysis through posture recognition is an essential research in robotic systems. Sitting with unhealthy sitting posture for a long time seriously harms human health and may even lead to lumbar disease, cervical disease and myopia. Automatic vision-based detection of unhealthy sitting posture, as an example of posture detection in robotic systems, has become a hot research topic. However, the existing methods only focus on extracting features of human themselves and lack understanding relevancies among objects in the scene, and henceforth fail to recognize some types of unhealthy sitting postures in complicated environments. To alleviate these problems, a scene recognition and semantic analysis approach to unhealthy sitting posture detection in screen-reading is proposed in this paper. The key skeletal points of human body are detected and tracked with a Microsoft Kinect sensor. Meanwhile, a deep learning method, Faster R-CNN, is used in the scene recognition of our method to accurately detect objects and extract relevant features. Then our method performs semantic analysis through Gaussian-Mixture behavioral clustering for scene understanding. The relevant features in the scene and the skeletal features extracted from human are fused into the semantic features to discriminate various types of sitting postures. Experimental results demonstrated that our method accurately and effectively detected various types of unhealthy sitting postures in screen-reading and avoided error detection in complicated environments. Compared with the existing methods, our proposed method detected more types of unhealthy sitting postures including those that the existing methods could not detect. Our method can be potentially applied and integrated as a medical assistance in robotic systems of health care and treatment.

Design and Validation of Depth Camera-Based Static Posture Assessment System

Healthy Human Sitting Posture Estimation in RGB-D Scenes Using Object Context

Detecting Improper Sitting Posture with a Lateral Positioned Motion- Sensing Camera

A Sitting Posture Surveillance System Based on Kinect

A Privacy-Preserving and Unobtrusive Sitting Posture Recognition System Via Pressure Array Sensor and Infrared Array Sensor for Office Workers

A Pipeline for Creating In-Vehicle Posture Database for Developing Driver Posture Monitoring Systems

Vision-based Postural Risk Auto-assessment Method for Sit-stand Office Working Using REBA

Preliminary Study: Development of a Multi-Angle Posture and Scoliosis Assessment System Based on Deep Learning

A New Kinect Approach To Judge Unhealthy Sitting Posture Based On Neck Angle And Torso Angle

SitPose: Real-Time Detection of Sitting Posture and Sedentary Behavior Using Ensemble Learning With Depth Sensor

Design and Implementation of a Noncontact Sleep Monitoring System Using Infrared Cameras and Motion Sensor.

Design and Implementation of a Body Posture Detection System

A Scene Recognition and Semantic Analysis Approach to Unhealthy Sitting Posture Detection during Screen-Reading

Design and implementation of a human posture capture system based on AHRS

View independent human posture identification using Kinect

Machine Vision Based Physical Fitness Measurement with Human Posture Recognition and Skeletal Data Smoothing

Kinect-based intelligent monitoring and warning of students' sitting posture

Reliability and Validity of Kinect RGB-D Sensor for Assessing Standing Balance

Design and application of testing system for visual-feedback-based posture adjusting ability

A New Kinect-Based Posture Recognition Method in Physical Sports Training Based on Urban Data

Enhancing Body Mechanics Training for Bedside Care Activities with a Kinect-Based System