Abstract:Background: Autism spectrum disorder (ASD) is currently diagnosed using qualitative methods that measure between 20-100 behaviors, can span multiple appointments with trained clinicians, and take several hours to complete. In our previous work, we demonstrated the efficacy of machine learning classifiers to accelerate the process by collecting home videos of US-based children, identifying a reduced subset of behavioral features that are scored by untrained raters using a machine learning classifier to determine children's "risk scores" for autism. We achieved an accuracy of 92% (95% CI 88%-97%) on US videos using a classifier built on five features. Objective: Using videos of Bangladeshi children collected from Dhaka Shishu Children's Hospital, we aim to scale our pipeline to another culture and other developmental delays, including speech and language conditions. Methods: Although our previously published and validated pipeline and set of classifiers perform reasonably well on Bangladeshi videos (75% accuracy, 95% CI 71%-78%), this work improves on that accuracy through the development and application of a powerful new technique for adaptive aggregation of crowdsourced labels. We enhance both the utility and performance of our model by building two classification layers: The first layer distinguishes between typical and atypical behavior, and the second layer distinguishes between ASD and non-ASD. In each of the layers, we use a unique rater weighting scheme to aggregate classification scores from different raters based on their expertise. We also determine Shapley values for the most important features in the classifier to understand how the classifiers' process aligns with clinical intuition. Results: Using these techniques, we achieved an accuracy (area under the curve [AUC]) of 76% (SD 3%) and sensitivity of 76% (SD 4%) for identifying atypical children from among developmentally delayed children, and an accuracy (AUC) of 85% (SD 5%) and sensitivity of 76% (SD 6%) for identifying children with ASD from those predicted to have other developmental delays. Conclusions: These results show promise for using a mobile video-based and machine learning-directed approach for early and remote detection of autism in Bangladeshi children. This strategy could provide important resources for developmental health in developing countries with few clinical resources for diagnosis, helping children get access to care at an early age. Future research aimed at extending the application of this approach to identify a range of other conditions and determine the population-level burden of developmental disabilities and impairments will be of high value.

Using visual attention estimation on videos for automated prediction of autism spectrum disorder and symptom severity in preschool children

Effective And Efficient Visual Stimuli Design For Quantitative Autism Screening: An Exploratory Study

A deep learning predictive classifier for autism screening and diagnosis

Computer vision tools for the non-invasive assessment of autism-related behavioral markers

Gaze-Wasserstein: a Quantitative Screening Approach to Autism Spectrum Disorders

A Convolutional Neural Network for gaze preference detection: A potential tool for diagnostics of autism spectrum disorder in children

Video-Based Autism Detection with Deep Learning

Investigation of Eye-Tracking Scan Path as a Biomarker for Autism Screening Using Machine Learning Algorithms

Learning Visual Attention to Identify People with Autism Spectrum Disorder.

Automatic Detection of ADHD and ASD from Expressive Behaviour in RGBD Data

Automatic Identification of High-Risk Autism Spectrum Disorder: A Feasibility Study Using Video and Audio Data under the Still-Face Paradigm.

A Novel Dataset for Video-Based Autism Classification Leveraging Extra-Stimulatory Behavior

Advancing autism prediction through visual-based AI approaches: integrating advanced eye movement analysis and shape recognition with Kalman filtering

Early identification of autism spectrum disorder based on machine learning with eye-tracking data

Automatic Classification Of Children With Autism Spectrum Disorder By Using A Computerized Visual-Orienting Task

Classification of autism severity levels using facial features and eye gaze patterns

Computer Vision-Based Assessment of Autistic Children: Analyzing Interactions, Emotions, Human Pose, and Life Skills

Detecting Developmental Delay and Autism Through Machine Learning Models Using Home Videos of Bangladeshi Children: Development and Validation Study

Utilizing deep learning models in an intelligent eye-tracking system for autism spectrum disorder diagnosis

Enhanced multilevel autism classification for children using eye-tracking and hybrid CNN-RNN deep learning models

Attention-Focused Eye Gaze Analysis to Predict Autistic Traits Using Transfer Learning