Abstract:Background Deficits in the ability to use language in social contexts, including storytelling skills, are observed across the autism spectrum. Development in machine‐learning approaches may contribute to clinical psychology and psychiatry, given its potential to support decisions concerning the diagnosis and treatment of psychiatric conditions and disorders. Aims To evaluate the usefulness of deep neural networks for detecting autism spectrum disorder (ASD) from textual utterances, specifically from narrations produced by individuals with ASD. Methods & Procedures We examined two text encoders: Embeddings from Language Models (ELMo) and Universal Sentence Encoder (USE), and three classification algorithms: XGBoost, support vector machines, and dense neural network layer. We aimed to classify 25 participants with ASD and 25 participants with typical development (TD) based on their narrations produced during the Autism Diagnostic Observation Schedule, Second Edition (ADOS‐2) picture book task. The results of computational approaches were compared with the results of standardized testing and classifications made by two psychiatrists (raters). The raters were asked to read utterances produced by a participant (without an examiner's statements and additional information) and assign a participant to one of the two groups: ASD or with typical development (TD). Outcomes & Results The computer‐based models had higher sensitivity, specificity, positive predictive values and negative predictive values than the raters, and lower than the two standardized instruments: ADOS‐2 and Social Communication Questionnaire (SCQ). Conclusions & Implications Our findings lay the groundwork for future studies involving deep neural network‐based text representation models as tools for augmenting the ASD diagnosis or screening. Both ELMo and USE text encoders provided promising specificities, sensitivities, positive predictive values and negative predictive values. Our results indicate the usefulness of page‐level embeddings for utterance representation in ADOS‐2 picture book task. WHAT THIS PAPER ADDS What is already known on this subject Deficits in the use of language in social contexts, and narrative ability in particular, are observed across the autism spectrum. Most research on narrative skills has applied hand‐coding methods. Hitherto, machine‐learning methods were used mostly for image recognition problems and data from screening questionnaires for ASD classification. Detection of mental and developmental disorders from textual input is an emerging field for machine and deep‐learning methods. What this paper adds to existing knowledge This study explored the ability of several types of deep neural network‐based text representation models to detect ASD. Both ELMo and USE provided the most promising values of specificity, sensitivity, positive predictive values and negative predictive values. What are the potential or actual clinical implications of this work? Competitive accuracy, repeatability, speed and ease of operation are all advantages of computerized methods. They allow for objective and quantitative assessment of narrative ability and complex language skills. Deep neural network‐based text representation models could in the future support clinicians and augment the decision‐making process related to ASD diagnosis, screening and intervention planning.

Creating a diagnostic assessment model for autism spectrum disorder by differentiating lexicogrammatical choices through machine learning

Copiloting Diagnosis of Autism in Real Clinical Scenarios via LLMs

Classifying Autism From Crowdsourced Semistructured Speech Recordings: Machine Learning Model Comparison Study

Detecting Autism Spectrum Disorders with Machine Learning Models Using Speech Transcripts

An Automated Assessment Framework for Atypical Prosody and Stereotyped Idiosyncratic Phrases Related to Autism Spectrum Disorder.

A Machine Learning Approach to the Diagnosis of Autism Spectrum Disorder and Multi-Systemic Developmental Disorder Based on Retrospective Data and ADOS-2 Score

Exploring Speech Pattern Disorders in Autism using Machine Learning

Classifying Autism from Crowdsourced Semi-Structured Speech Recordings: A Machine Learning Approach

Autism Detection in Children: Integrating Machine Learning and Natural Language Processing in Narrative Analysis

A data driven machine learning approach to differentiate between autism spectrum disorder and attention-deficit/hyperactivity disorder based on the best-practice diagnostic instruments for autism

Exploiting ChatGPT for Diagnosing Autism-Associated Language Disorders and Identifying Distinct Features

On Scalable and Interpretable Autism Detection from Social Interaction Behavior

Toward mapping pragmatic impairment of autism spectrum disorder individuals through the development of a corpus of spoken Japanese

Detecting autism from picture book narratives using deep neural utterance embeddings

Machine learning in autistic spectrum disorder behavioral research: A review and ways forward

Evaluating Large Language Models' Ability Using a Psychiatric Screening Tool Based on Metaphor and Sarcasm Scenarios

An Evaluation of Machine Learning Approaches for Early Diagnosis of Autism Spectrum Disorder

Developing a New Autism Diagnosis Process Based on a Hybrid Deep Learning Architecture Through Analyzing Home Videos

Study of Machine Learning Models to Detect Autism Spectrum Disorder

Machine learning classification of autism spectrum disorder based on reciprocity in naturalistic social interactions

Machine Learning Differentiation of Autism Spectrum Sub-Classifications.