Abstract:Abstract Objective Preterm infants are at high risk of neuromotor disorders. Recent advances in digital technology and machine learning algorithms have enabled the tracking and recognition of anatomical key points of the human body. It remains unclear whether the proposed pose estimation model and the skeleton-based action recognition model for adult movement classification are applicable and accurate for infant motor assessment. Therefore, this study aimed to develop and validate an artificial intelligence (AI) model framework for movement recognition in full-term and preterm infants. Methods This observational study prospectively assessed 30 full-term infants and 54 preterm infants using the Alberta Infant Motor Scale (58 movements) from 4 to 18 months of age with their movements recorded by 5 video cameras simultaneously in a standardized clinical setup. The movement videos were annotated for the start/end times and presence of movements by 3 pediatric physical therapists. The annotated videos were used for the development and testing of an AI algorithm that consisted of a 17-point human pose estimation model and a skeleton-based action recognition model. Results The infants contributed 153 sessions of Alberta Infant Motor Scale assessment that yielded 13,139 videos of movements for data processing. The intra and interrater reliabilities for movement annotation of videos by the therapists showed high agreements (88%–100%). Thirty-one of the 58 movements were selected for machine learning because of sufficient data samples and developmental significance. Using the annotated results as the standards, the AI algorithm showed satisfactory agreement in classifying the 31 movements (accuracy = 0.91, recall = 0.91, precision = 0.91, and F1 score = 0.91). Conclusion The AI algorithm was accurate in classifying 31 movements in full-term and preterm infants from 4 to 18 months of age in a standardized clinical setup. Impact The findings provide the basis for future refinement and validation of the algorithm on home videos to be a remote infant movement assessment.

Evaluation Method of Motor Coordination Ability in Children Based on Machine Vision

Study on Assessment Methods of Developmental Coordination Disorder in Children

Evaluation of the Fine Motor Skills of Children with DCD Using the Digitalised Visual-Motor Tracking System

Automated Measurement of Ocular Movements Using Deep Learning-Based Image Analysis

A Markerless Visual-Motor Tracking System for Behavior Monitoring in DCD Assessment

Development And Evaluation Of A Multimodal Sensor Motor Learning Assessment

Objective and automatic assessment approach for diagnosing attention-deficit/hyperactivity disorder based on skeleton detection and classification analysis in outpatient videos

Automatically Measure the Quality of Infants’ Spontaneous Movement Via Videos to Predict the Risk of Cerebral Palsy

Behavior Analysis With Integrated Visual-Motor Tracking for Developmental Coordination Disorder

A Training-Free Infant Spontaneous Movement Assessment Method for Cerebral Palsy Prediction Based on Videos.

Assessing visual motor performance in autistic children based on Kinect and fNIRS: A case study

A Spatio-temporal Attention-based Model for Infant Movement Assessment from Videos

Quantitative Coordination Evaluation for Screening Children with Duchenne Muscular Dystrophy.

Kinematic Assessment of Fine Motor Skills in Children: Comparison of a Kinematic Approach and a Standardized Test

Motor Function Evaluation of Hemiplegic Upper-Extremities Using Data Fusion from Wearable Inertial and Surface EMG Sensors

Image-recognition-based System for Precise Hand Function Evaluation

Application of Artificial Intelligence in Infant Movement Classification: A Reliability and Validity Study in Infants Who Were Full-Term and Preterm

Kinematics Index for Motor-Function Evaluation of Shoulder and Elbow Joints

Automating General Movements Assessment with Quantitative Deep Learning to Facilitate Early Screening of Cerebral Palsy

A multifactorial detection model of young children’s physical abnormality based on image recognition technology under the concept of physical and health integration

Comparison of marker-less 2D image-based methods for infant pose estimation