Abstract:Deficits in responding to joint attention (RJA) are early symptoms of autism spectrum disorder (ASD). Currently, no automated tools exist for identifying and quantifying RJA behaviors. A few eye tracking studies have investigated RJA in ASD children but have produced conflicting results. In addition, little is known about the trajectory of RJA development through developmental age. Here, a new video was designed including 12 clips of an actor pointing to or looking at an object. Eye tracking technology was used to monitor RJA in three groups: 143 ASD children assessed with the Autism Diagnostic Interview-Revised (ADI-R) and the Autism Diagnostic Observation Schedule (ADOS) (4-7 years old), 113 age- and gender-matched typically developing children (TDC), and 43 typically developing adults (TDA) (19-32 years old). RJAfinder was developed in R and MATLAB to quantify RJA events from the eye tracking data. RJA events were compared among the three groups. Spearman correlation coefficients between total number of RJA events in ASD and the Social Responsiveness Scale (SRS) scores were calculated. A logistic regression model was built using the average valid sampling rate and the total number of RJA events as two predictive variables to classify ASD and TDC groups. ASD children displayed statistically significantly less RJA events than the TDC and TDA groups with medium-to-large-sized effects. ASD and TDC children both displayed more RJA events in response to pointing stimuli than to looking stimuli. Our logistic regression model predicted ASD tendency with 0.76 accuracy in the testing set. RJA ability improved more slowly between the ages of 4-7 years old in the ASD group than in the TDC group. In ASD children, RJA ability showed negative correlation with SRS total T-score as well as the scores of five subdomains. Our study provides an automated tool for quantifying RJA and insights for the study of RJA in ASD children, which may help improve ASD screening, subtyping, and behavior interventions.

Detection of Response to Instruction in Autistic Children Based on Human-Object Interaction

Early Screening of Autism in Toddlers Via Response-To-Instructions Protocol

Computational Interpersonal Communication Model for Screening Autistic Toddlers: A Case Study of Response-to-Name

Automatic Identification of High-Risk Autism Spectrum Disorder: A Feasibility Study Using Video and Audio Data under the Still-Face Paradigm.

Vision-Based Action Detection for RTI Protocol of ASD Early Screening

A multimodal machine learning system in early screening for toddlers with autism spectrum disorders based on the response to name

Automatic Classification Of Children With Autism Spectrum Disorder By Using A Computerized Visual-Orienting Task

A Humanoid Robot Used as an Assistive Intervention Tool for Children with Autism Spectrum Disorder: A Preliminary Research

Social Recognition of Joint Attention Cycles in Children with Autism Spectrum Disorders

Application of Humanoid Robot in Intervention for Autistic Children

Vision-Based Pointing Estimation and Evaluation in Toddlers for Autism Screening

Toward Improving Social Interaction Ability for Children with Autism Spectrum Disorder Using Social Signals

Parent-Child Interaction as an Effective Tool for Identifying Autism Spectrum Disorder: Evidence from EEG Analysis

RJAfinder: an Automated Tool for Quantification of Responding to Joint Attention Behaviors in Autism Spectrum Disorder Using Eye Tracking Data

Computer vision tools for the non-invasive assessment of autism-related behavioral markers

Diagnosing Human-object Interaction Detectors

Computer-Aided Autism Spectrum Disorder Diagnosis With Behavior Signal Processing

Screening and Prediction of Autism in Toddlers Using SORF in Videos of Brief Family Interactions

An affordable compact humanoid robot for Autism Spectrum Disorder interventions in children

A VR-based Training and Intelligent Assessment System Integrated with Multi-modal Sensing for Children with Autism Spectrum Disorder

Design of Humanoid Robot Based Training APP on Social Skills of Children with Autism Spectrum Disorder