Abstract:Background: Autism spectrum disorder (ASD) is currently diagnosed using qualitative methods that measure between 20-100 behaviors, can span multiple appointments with trained clinicians, and take several hours to complete. In our previous work, we demonstrated the efficacy of machine learning classifiers to accelerate the process by collecting home videos of US-based children, identifying a reduced subset of behavioral features that are scored by untrained raters using a machine learning classifier to determine children's "risk scores" for autism. We achieved an accuracy of 92% (95% CI 88%-97%) on US videos using a classifier built on five features. Objective: Using videos of Bangladeshi children collected from Dhaka Shishu Children's Hospital, we aim to scale our pipeline to another culture and other developmental delays, including speech and language conditions. Methods: Although our previously published and validated pipeline and set of classifiers perform reasonably well on Bangladeshi videos (75% accuracy, 95% CI 71%-78%), this work improves on that accuracy through the development and application of a powerful new technique for adaptive aggregation of crowdsourced labels. We enhance both the utility and performance of our model by building two classification layers: The first layer distinguishes between typical and atypical behavior, and the second layer distinguishes between ASD and non-ASD. In each of the layers, we use a unique rater weighting scheme to aggregate classification scores from different raters based on their expertise. We also determine Shapley values for the most important features in the classifier to understand how the classifiers' process aligns with clinical intuition. Results: Using these techniques, we achieved an accuracy (area under the curve [AUC]) of 76% (SD 3%) and sensitivity of 76% (SD 4%) for identifying atypical children from among developmentally delayed children, and an accuracy (AUC) of 85% (SD 5%) and sensitivity of 76% (SD 6%) for identifying children with ASD from those predicted to have other developmental delays. Conclusions: These results show promise for using a mobile video-based and machine learning-directed approach for early and remote detection of autism in Bangladeshi children. This strategy could provide important resources for developmental health in developing countries with few clinical resources for diagnosis, helping children get access to care at an early age. Future research aimed at extending the application of this approach to identify a range of other conditions and determine the population-level burden of developmental disabilities and impairments will be of high value.

Video-audio neural network ensemble for comprehensive screening of autism spectrum disorder in young children

Autism Screening Using Deep Embedding Representation

A deep learning predictive classifier for autism screening and diagnosis

Diagnostic Classification and Prognostic Prediction Using Common Genetic Variants in Autism Spectrum Disorder: Genotype-Based Deep Learning

Video-Based Autism Detection with Deep Learning

Ensemble Modeling of Multiple Physical Indicators to Dynamically Phenotype Autism Spectrum Disorder

Machine learning approach for early detection of autism by combining questionnaire and home video screening

Autism Screening in Toddlers and Adults Using Deep Learning and Fair AI Techniques

Classifying Autism from Crowdsourced Semi-Structured Speech Recordings: A Machine Learning Approach

Multi-modular AI Approach to Streamline Autism Diagnosis in Young Children

Using visual attention estimation on videos for automated prediction of autism spectrum disorder and symptom severity in preschool children

Developing a New Autism Diagnosis Process Based on a Hybrid Deep Learning Architecture Through Analyzing Home Videos

Bimodal Feature Analysis with Deep Learning for Autism Spectrum Disorder Detection

Detecting Autism Spectrum Disorders with Machine Learning Models Using Speech Transcripts

Weakly-supervised Autism Severity Assessment in Long Videos

Developing an Artificial Intelligence Based Model for Autism Spectrum Disorder Detection in Children

Detecting Developmental Delay and Autism Through Machine Learning Models Using Home Videos of Bangladeshi Children: Development and Validation Study

Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition

ASD-SAENet: A Sparse Autoencoder, and Deep-Neural Network Model for Detecting Autism Spectrum Disorder (ASD) Using fMRI Data

Towards Child-Inclusive Clinical Video Understanding for Autism Spectrum Disorder

An Improved AlexNet Model and Cepstral Coefficient-Based Classification of Autism Using EEG