Abstract:Behavior analysis through posture recognition is an essential research in robotic systems. Sitting with unhealthy sitting posture for a long time seriously harms human health and may even lead to lumbar disease, cervical disease and myopia. Automatic vision-based detection of unhealthy sitting posture, as an example of posture detection in robotic systems, has become a hot research topic. However, the existing methods only focus on extracting features of human themselves and lack understanding relevancies among objects in the scene, and henceforth fail to recognize some types of unhealthy sitting postures in complicated environments. To alleviate these problems, a scene recognition and semantic analysis approach to unhealthy sitting posture detection in screen-reading is proposed in this paper. The key skeletal points of human body are detected and tracked with a Microsoft Kinect sensor. Meanwhile, a deep learning method, Faster R-CNN, is used in the scene recognition of our method to accurately detect objects and extract relevant features. Then our method performs semantic analysis through Gaussian-Mixture behavioral clustering for scene understanding. The relevant features in the scene and the skeletal features extracted from human are fused into the semantic features to discriminate various types of sitting postures. Experimental results demonstrated that our method accurately and effectively detected various types of unhealthy sitting postures in screen-reading and avoided error detection in complicated environments. Compared with the existing methods, our proposed method detected more types of unhealthy sitting postures including those that the existing methods could not detect. Our method can be potentially applied and integrated as a medical assistance in robotic systems of health care and treatment.

UBIQUITOUS SENSING FOR POSTURE/BEHAVIOR ANALYSIS

Healthy Human Sitting Posture Estimation in RGB-D Scenes Using Object Context

FROM IMAGING NETWORKS TO BEHAVIOR PROFILING: UBIQUITOUS SENSING FOR MANAGED HOMECARE OF THE ELDERLY

Towards Image-Based Modeling for Ambient Sensing.

A Privacy-Preserving and Unobtrusive Sitting Posture Recognition System Via Pressure Array Sensor and Infrared Array Sensor for Office Workers

A Scene Recognition and Semantic Analysis Approach to Unhealthy Sitting Posture Detection during Screen-Reading

Human Posture Detection Method Based on Wearable Devices

Posture Detection Based on Smart Cushion for Wheelchair Users

Recent Advances and Challenges in Ubiquitous Sensing

Automated Patient Handling Activity Recognition for At-Risk Caregivers Using an Unobtrusive Wearable Sensor

Flexible, Wireless, Multifunctional Integrated Electronic System for Daily Wearable Gait Detection

Human Posture Recognition in Intelligent Healthcare

Body Sensor Network for Ubiquitous Health Monitoring

Classification of static postures with wearable sensors mounted on loose clothing

Vision-based human pose estimation for pervasive computing

Toward Pervasive Gait Analysis With Wearable Sensors: A Systematic Review.

Sensor-Based Wearable Systems for Monitoring Human Motion and Posture: A Review

Wearable and Ambient Sensor Fusion for the Characterisation of Human Motion

A Wearable Sensor Network With Embedded Machine Learning for Real-Time Motion Analysis and Complex Posture Detection

An Integrated Wireless Wearable Sensor System for Posture Recognition and Indoor Localization

Benchmarking ML Approaches to UWB-Based Range-Only Posture Recognition for Human Robot-Interaction