Abstract:Background: Prolonged improper posture can lead to forward head posture (FHP), causing headaches, impaired respiratory function, and fatigue. This is especially relevant in sedentary scenarios, where individuals often maintain static postures for extended periods-a significant part of daily life for many. The development of a system capable of detecting FHP is crucial, as it would not only alert users to correct their posture but also serve the broader goal of contributing to public health by preventing the progression of chronic injuries associated with this condition. However, despite significant advancements in estimating human poses from standard 2D images, most computational pose models do not include measurements of the craniovertebral angle, which involves the C7 vertebra, crucial for diagnosing FHP. Objective: Accurate diagnosis of FHP typically requires dedicated devices, such as clinical postural assessments or specialized imaging equipment, but their use is impractical for continuous, real-time monitoring in everyday settings. Therefore, developing an accessible, efficient method for regular posture assessment that can be easily integrated into daily activities, providing real-time feedback, and promoting corrective action, is necessary. Methods: The system sequentially estimates 2D and 3D human anatomical key points from a provided 2D image, using the Detectron2D and VideoPose3D algorithms, respectively. It then uses a graph convolutional network (GCN), explicitly crafted to analyze the spatial configuration and alignment of the upper body's anatomical key points in 3D space. This GCN aims to implicitly learn the intricate relationship between the estimated 3D key points and the correct posture, specifically to identify FHP. Results: The test accuracy was 78.27% when inputs included all joints corresponding to the upper body key points. The GCN model demonstrated slightly superior balanced performance across classes with an F1-score (macro) of 77.54%, compared to the baseline feedforward neural network (FFNN) model's 75.88%. Specifically, the GCN model showed a more balanced precision and recall between the classes, suggesting its potential for better generalization in FHP detection across diverse postures. Meanwhile, the baseline FFNN model demonstrates a higher precision for FHP cases but at the cost of lower recall, indicating that while it is more accurate in confirming FHP when detected, it misses a significant number of actual FHP instances. This assertion is further substantiated by the examination of the latent feature space using t-distributed stochastic neighbor embedding, where the GCN model presented an isotropic distribution, unlike the FFNN model, which showed an anisotropic distribution. Conclusions: Based on 2D image input using 3D human pose estimation joint inputs, it was found that it is possible to learn FHP-related features using the proposed GCN-based network to develop a posture correction system. We conclude the paper by addressing the limitations of our current system and proposing potential avenues for future work in this area.

3D PostureNet: A unified framework for skeleton-based posture recognition

Mpose: Environment- and Subject-Agnostic 3D Skeleton Posture Reconstruction Leveraging a Single Mmwave Device

Classroom Student Posture Recognition Based on an Improved High-Resolution Network.

Single Image Depth Map Estimation for Improving Posture Recognition

A Survey on Artificial Intelligence in Posture Recognition

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

Aerobics posture recognition based on neural network and sensors

3D-UGCN: A Unified Graph Convolutional Network for Robust 3D Human Pose Estimation from Monocular RGB Images

A Study of Dance Movement Capture and Posture Recognition Method Based on Vision Sensors

Body Structure Constraint for 3D Human Pose Estimation

PONet: Robust 3D Human Pose Estimation via Learning Orientations Only

A 3D Hand Attitude Estimation Method for Fixed Hand Posture Based on Dual-View RGB Images

Human posture estimation and action recognition on fitness behavior and fitness

CSI-Net: Unified Human Body Characterization and Pose Recognition

Recognition of Forward Head Posture Through 3D Human Pose Estimation With a Graph Convolutional Network: Development and Feasibility Study

Pose ResNet: 3D Human Pose Estimation Based on Self-Supervision

A Multi-Scale and Multi-Stage Human Pose Recognition Method Based on Convolutional Neural Networks for Non-Wearable Ergonomic Evaluation

A three-dimensional human motion pose recognition algorithm based on graph convolutional networks

Hand3D: Hand Pose Estimation using 3D Neural Network

Optimization of Human Posture Recognition based on Multi-view Skeleton Data Fusion

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images