Abstract:Background and objective: The analysis of spontaneous movements of preterm infants is important because anomalous motion patterns can be a sign of neurological disorders caused by lesions in the developing brain. A diagnosis in the first weeks of child's life is crucial to plan timely and appropriate rehabilitative interventions. An accurate visual assessment of infants' spontaneous movements requires highly specialized personnel, not always available, and it is operator dependent. Motion capture systems, markers and wearable sensors are commonly used for human motion analysis, but they can be cumbersome, limiting their use in the study of infants' movements. Methods: In this paper we propose a computer-aided pipeline to characterize and classify infants' motion from 2D video recordings. The final goal is detecting anomalous motion patterns. The implemented pipeline is based on computer vision and machine learning algorithms and includes a specific step to increase the interpretability of the results. Specifically, it can be summarized by the following steps: (i) body keypoints detection: we rely on a deep learning-based semantic features detector to localize the positions of meaningful landmark points on infants' bodies; (ii) parameters extraction: starting from the trajectories of the detected landmark points, we extract quantitative parameters describing infants motion patterns; (iii) classification: we implement different classifiers (Support Vector Machines, Random Forest, fully connected Neural Network, Long Short Term Memory) that, starting from the motion parameters, classify between normal or abnormal motion patterns. Results: We tested the proposed pipeline on a dataset, recorded at the 40th gestational week, of 142 infants, 59 with evidence of neuromotor disorders according to a medical assessment carried out a posteriori. Our procedure successfully discriminates normal and anomalous motion patterns with a maximum accuracy of 85.7%. Conclusions: In conclusion, our pipeline has the potential to be adopted as a tool to support the early detection of abnormal motion patterns in preterm infants.

A Spatio-temporal Attention-based Model for Infant Movement Assessment from Videos

A Training-Free Infant Spontaneous Movement Assessment Method for Cerebral Palsy Prediction Based on Videos.

Automatically Measure the Quality of Infants’ Spontaneous Movement Via Videos to Predict the Risk of Cerebral Palsy

A self-supervised spatio-temporal attention network for video-based 3D infant pose estimation

Detection of Infantile Movement Disorders in Video Data Using Deformable Part-Based Model

RGB-D Videos-Based Early Prediction of Infant Cerebral Palsy Via General Movements Complexity

Assessing infant risk of cerebral palsy with video-based motion tracking

A pose estimation for motion tracking of infants cerebral palsy

Quantifying spontaneous infant movements using state-space models

Enhanced Infant Movement Analysis Using Transformer-Based Fusion of Diverse Video Features For Neurodevelopmental Monitoring

Towards early prediction of neurodevelopmental disorders: Computational model for Face Touch and Self-adaptors in Infants

IMU-Based Approach to Detect Spastic Cerebral Palsy in Infants at Early Stages

Automating General Movements Assessment with Quantitative Deep Learning to Facilitate Early Screening of Cerebral Palsy

Preterm infants' pose estimation with spatio-temporal features

Evaluating Explainable AI Methods in Deep Learning Models for Early Detection of Cerebral Palsy

Video Human Segmentation using Fuzzy Object Models and its Application to Body Pose Estimation of Toddlers for Behavior Studies

A markerless pipeline to analyze spontaneous movements of preterm infants

Automated Classification of General Movements in Infants Using a Two-stream Spatiotemporal Fusion Network

Three-Dimensional Pose Estimation of Infants Lying Supine Using Data from a Kinect Sensor with Low Training Cost

Adapting Action Recognition Neural Networks for Automated Infantile Spasm Detection

Infant movement classification through pressure distribution analysis