Abstract:Background and objective: The analysis of spontaneous movements of preterm infants is important because anomalous motion patterns can be a sign of neurological disorders caused by lesions in the developing brain. A diagnosis in the first weeks of child's life is crucial to plan timely and appropriate rehabilitative interventions. An accurate visual assessment of infants' spontaneous movements requires highly specialized personnel, not always available, and it is operator dependent. Motion capture systems, markers and wearable sensors are commonly used for human motion analysis, but they can be cumbersome, limiting their use in the study of infants' movements. Methods: In this paper we propose a computer-aided pipeline to characterize and classify infants' motion from 2D video recordings. The final goal is detecting anomalous motion patterns. The implemented pipeline is based on computer vision and machine learning algorithms and includes a specific step to increase the interpretability of the results. Specifically, it can be summarized by the following steps: (i) body keypoints detection: we rely on a deep learning-based semantic features detector to localize the positions of meaningful landmark points on infants' bodies; (ii) parameters extraction: starting from the trajectories of the detected landmark points, we extract quantitative parameters describing infants motion patterns; (iii) classification: we implement different classifiers (Support Vector Machines, Random Forest, fully connected Neural Network, Long Short Term Memory) that, starting from the motion parameters, classify between normal or abnormal motion patterns. Results: We tested the proposed pipeline on a dataset, recorded at the 40th gestational week, of 142 infants, 59 with evidence of neuromotor disorders according to a medical assessment carried out a posteriori. Our procedure successfully discriminates normal and anomalous motion patterns with a maximum accuracy of 85.7%. Conclusions: In conclusion, our pipeline has the potential to be adopted as a tool to support the early detection of abnormal motion patterns in preterm infants.

Stereo 3D tracking of infants in natural play conditions

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

A self-supervised spatio-temporal attention network for video-based 3D infant pose estimation

Estimation of human body 3D pose for parent-infant interaction settings using azure Kinect and OpenPose

Three-Dimensional Pose Estimation of Infants Lying Supine Using Data from a Kinect Sensor with Low Training Cost

Automatic Posture and Movement Tracking of Infants with Wearable Movement Sensors

A pose estimation for motion tracking of infants cerebral palsy

Dynamic Gaussian Splatting from Markerless Motion Capture can Reconstruct Infants Movements

A markerless pipeline to analyze spontaneous movements of preterm infants

Deep-learning for automated markerless tracking of infants general movements

Concurrent Validity of Motion Parameters Measured With an RGB-D Camera-Based Markerless 3D Motion Tracking Method in Children and Young Adults

A Markless 3D Human Motion Data Acquisition Method Based on the Binocular Stereo Vision and Lightweight Open Pose Algorithm

Automatic infant 2D pose estimation from videos: comparing seven deep neural network methods

Preterm infants' pose estimation with spatio-temporal features

Computer Vision to the Rescue: Infant Postural Symmetry Estimation from Incongruent Annotations

Human Posture Tracking and Classification through Stereo Vision and 3D Model Matching

Tracking Emerges by Looking Around Static Scenes, with Neural 3D Mapping

A Novel Binocular Eye-Tracking SystemWith Stereo Stimuli for 3D Gaze Estimation

Markerless Motion Capture Using Appearance and Inertial Data

A Novel Integrated Eye-Tracking System with Stereo Stimuli for 3-D Gaze Estimation

Tracking 3-D Motion of Dynamic Objects Using Monocular Visual-Inertial Sensing