Abstract:Background: Autism spectrum disorder (ASD) is currently diagnosed using qualitative methods that measure between 20-100 behaviors, can span multiple appointments with trained clinicians, and take several hours to complete. In our previous work, we demonstrated the efficacy of machine learning classifiers to accelerate the process by collecting home videos of US-based children, identifying a reduced subset of behavioral features that are scored by untrained raters using a machine learning classifier to determine children's "risk scores" for autism. We achieved an accuracy of 92% (95% CI 88%-97%) on US videos using a classifier built on five features. Objective: Using videos of Bangladeshi children collected from Dhaka Shishu Children's Hospital, we aim to scale our pipeline to another culture and other developmental delays, including speech and language conditions. Methods: Although our previously published and validated pipeline and set of classifiers perform reasonably well on Bangladeshi videos (75% accuracy, 95% CI 71%-78%), this work improves on that accuracy through the development and application of a powerful new technique for adaptive aggregation of crowdsourced labels. We enhance both the utility and performance of our model by building two classification layers: The first layer distinguishes between typical and atypical behavior, and the second layer distinguishes between ASD and non-ASD. In each of the layers, we use a unique rater weighting scheme to aggregate classification scores from different raters based on their expertise. We also determine Shapley values for the most important features in the classifier to understand how the classifiers' process aligns with clinical intuition. Results: Using these techniques, we achieved an accuracy (area under the curve [AUC]) of 76% (SD 3%) and sensitivity of 76% (SD 4%) for identifying atypical children from among developmentally delayed children, and an accuracy (AUC) of 85% (SD 5%) and sensitivity of 76% (SD 6%) for identifying children with ASD from those predicted to have other developmental delays. Conclusions: These results show promise for using a mobile video-based and machine learning-directed approach for early and remote detection of autism in Bangladeshi children. This strategy could provide important resources for developmental health in developing countries with few clinical resources for diagnosis, helping children get access to care at an early age. Future research aimed at extending the application of this approach to identify a range of other conditions and determine the population-level burden of developmental disabilities and impairments will be of high value.

NurtureNet: A Multi-task Video-based Approach for Newborn Anthropometry

Development of smart phone-based child health screening tools for community health workers

Designing and evaluating a Nutritional Assessment and Intervention Kiosk for mother-child dyad to combat double burden of malnutrition

Advancing Smart Malnutrition Monitoring: A Multi-Modal Learning Approach for Vital Health Parameter Estimation

Software development process of Neotree - a data capture and decision support system to improve newborn healthcare in low-resource settings

Three-year review of a capacity building pilot for a sustainable regional network on food, nutrition and health systems education in India

Deep learning based non-contact physiological monitoring in Neonatal Intensive Care Unit

Implementing neuroimaging and eye tracking methods to assess neurocognitive development of young infants in low- and middle-income countries

Food/Non-Food Classification of Real-Life Egocentric Images in Low- and Middle-Income Countries Based on Image Tagging Features

Machine Learning-Based Automatic Classification of Video Recorded Neonatal Manipulations and Associated Physiological Parameters: A Feasibility Study

A Video-based End-to-end Pipeline for Non-nutritive Sucking Action Recognition and Segmentation in Young Infants

An Intelligent Passive Food Intake Assessment System with Egocentric Cameras

Subtle Signals: Video-based Detection of Infant Non-nutritive Sucking as a Neurodevelopmental Cue

Leveraging technological advances to assess dyadic visual cognition during infancy in high- and low-resource settings

Neonatal Face and Facial Landmark Detection from Video Recordings

Integrating multimodal learning for improved vital health parameter estimation

Activity Recognition From Newborn Resuscitation Videos

FetalNet: Multi-task Deep Learning Framework for Fetal Ultrasound Biometric Measurements

The association of a novel digital tool for assessment of early childhood cognitive development, 'DEvelopmental assessment on an E-Platform (DEEP)', with growth in rural India: A proof of concept study

Detecting Developmental Delay and Autism Through Machine Learning Models Using Home Videos of Bangladeshi Children: Development and Validation Study

Fetal growth analysis from ultrasound videos based on different biometrics using optimal segmentation and hybrid classifier