Abstract:Background and objective: The analysis of spontaneous movements of preterm infants is important because anomalous motion patterns can be a sign of neurological disorders caused by lesions in the developing brain. A diagnosis in the first weeks of child's life is crucial to plan timely and appropriate rehabilitative interventions. An accurate visual assessment of infants' spontaneous movements requires highly specialized personnel, not always available, and it is operator dependent. Motion capture systems, markers and wearable sensors are commonly used for human motion analysis, but they can be cumbersome, limiting their use in the study of infants' movements. Methods: In this paper we propose a computer-aided pipeline to characterize and classify infants' motion from 2D video recordings. The final goal is detecting anomalous motion patterns. The implemented pipeline is based on computer vision and machine learning algorithms and includes a specific step to increase the interpretability of the results. Specifically, it can be summarized by the following steps: (i) body keypoints detection: we rely on a deep learning-based semantic features detector to localize the positions of meaningful landmark points on infants' bodies; (ii) parameters extraction: starting from the trajectories of the detected landmark points, we extract quantitative parameters describing infants motion patterns; (iii) classification: we implement different classifiers (Support Vector Machines, Random Forest, fully connected Neural Network, Long Short Term Memory) that, starting from the motion parameters, classify between normal or abnormal motion patterns. Results: We tested the proposed pipeline on a dataset, recorded at the 40th gestational week, of 142 infants, 59 with evidence of neuromotor disorders according to a medical assessment carried out a posteriori. Our procedure successfully discriminates normal and anomalous motion patterns with a maximum accuracy of 85.7%. Conclusions: In conclusion, our pipeline has the potential to be adopted as a tool to support the early detection of abnormal motion patterns in preterm infants.

Enhanced Infant Movement Analysis Using Transformer-Based Fusion of Diverse Video Features For Neurodevelopmental Monitoring

Deep learning empowered sensor fusion boosts infant movement classification

Towards early prediction of neurodevelopmental disorders: Computational model for Face Touch and Self-adaptors in Infants

Automated Classification of General Movements in Infants Using a Two-stream Spatiotemporal Fusion Network

A Spatio-temporal Attention-based Model for Infant Movement Assessment from Videos

Comparison of end-to-end neural network architectures and data augmentation methods for automatic infant motility assessment using wearable sensors

Application of Artificial Intelligence in Infant Movement Classification: A Reliability and Validity Study in Infants Who Were Full-Term and Preterm

Automated Prediction of Infant Cognitive Development Risk by Video: A Pilot Study

Transformer based multi-modal MRI fusion for prediction of post-menstrual age and neonatal brain development analysis

Detection of Infantile Movement Disorders in Video Data Using Deformable Part-Based Model

Automatic Posture and Movement Tracking of Infants with Wearable Movement Sensors

A markerless pipeline to analyze spontaneous movements of preterm infants

Video-Based Automatic Baby Motion Analysis for Early Neurological Disorder Diagnosis: State of the Art and Future Directions

Intelligence Sparse Sensor Network for Automatic Early Evaluation of General Movements in Infants

Swin fMRI Transformer Predicts Early Neurodevelopmental Outcomes from Neonatal fMRI

Predicting Infant Motor Development Status using Day Long Movement Data from Wearable Sensors

Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data

AggPose: Deep Aggregation Vision Transformer for Infant Pose Estimation

Towards human-level performance on automatic pose estimation of infant spontaneous movements

2D Capsule Networks Detect Perceived Changes in Infant∼Environment Relationship Reflected in 3D Movement Dynamics

Automatic Quantitative Intelligent Assessment of Neonatal General Movements with Video Tracking