Abstract:There are increasing efforts to automate clinical methods for early diagnosis of developmental disorders, among them the General Movement Assessment (GMA), a video-based tool to classify infant motor functioning. Optimal pose estimation is a crucial part of the automated GMA. In this study we compare the performance of available generic- and infant-pose estimators, and the choice of viewing angle for optimal recordings, i.e., conventional diagonal view used in GMA vs. top-down view. For this study, we used 4500 annotated video-frames from 75 recordings of infant spontaneous motor functions from 4 to 26 weeks. To determine which available pose estimation method and camera angle yield the best pose estimation accuracy on infants in a GMA related setting, the distance to human annotations as well as the percentage of correct key-points (PCK) were computed and compared. The results show that the best performing generic model trained on adults, ViTPose, also performs best on infants. We see no improvement from using specialized infant-pose estimators over the generic pose estimators on our own infant dataset. However, when retraining a generic model on our data, there is a significant improvement in pose estimation accuracy. The pose estimation accuracy obtained from the top-down view is significantly better than that obtained from the diagonal view, especially for the detection of the hip key-points. The results also indicate only limited generalization capabilities of infant-pose estimators to other infant datasets, which hints that one should be careful when choosing infant pose estimators and using them on infant datasets which they were not trained on. While the standard GMA method uses a diagonal view for assessment, pose estimation accuracy significantly improves using a top-down view. This suggests that a top-down view should be included in recording setups for automated GMA research.

Three-Dimensional Pose Estimation of Infants Lying Supine Using Data from a Kinect Sensor with Low Training Cost

A pose estimation for motion tracking of infants cerebral palsy

Healthy Human Sitting Posture Estimation in RGB-D Scenes Using Object Context

Human 3D Pose Estimation in a Lying Position by RGB-D Images for Medical Diagnosis and Rehabilitation.

RGB-D Videos-Based Early Prediction of Infant Cerebral Palsy Via General Movements Complexity

A self-supervised spatio-temporal attention network for video-based 3D infant pose estimation

Comparison of marker-less 2D image-based methods for infant pose estimation

Estimation of human body 3D pose for parent-infant interaction settings using azure Kinect and OpenPose

RGB-D Camera based Human Limb Movement Recognition and Tracking in Supine Positions.

Automatically Measure the Quality of Infants’ Spontaneous Movement Via Videos to Predict the Risk of Cerebral Palsy

Supine Infant Pose Estimation Via Single Depth Image.

Extending 3D body pose estimation for robotic-assistive therapies of autistic children

Automatic infant 2D pose estimation from videos: comparing seven deep neural network methods

Multiview Video-Based 3-D Pose Estimation of Patients in Computer-Assisted Rehabilitation Environment (CAREN).

Dressed human body three-dimensional bare body model calculation method through single Kinect

RGBD-Based Real-Time 3D Human Pose Estimation for Fitness Assessment

A Training-Free Infant Spontaneous Movement Assessment Method for Cerebral Palsy Prediction Based on Videos.

3D Human Pose Estimation in Motion Based on Multi-Stage Regression

Preterm infants' limb-pose estimation from depth images using convolutional neural networks

Accurate and Fast 3D Head Pose Estimation with Noisy RGBD Images

Towards Locality Similarity Preserving to 3D Human Pose Estimation.