Abstract:Purpose: This study examines the accuracy of Interaction Detection in Early Childhood Settings (IDEAS), a program that automatically transcribes audio files and estimates linguistic units relevant to speech-language therapy, including part-of-speech units that represent features of language complexity, such as adjectives and coordinating conjunctions. Method: Forty-five video-recorded speech-language therapy sessions involving 27 speech-language pathologists (SLPs) and 56 children were used. The F measure determines the accuracy of IDEAS diarization (i.e., speech segmentation and speaker classification). Two additional evaluation metrics, namely, median absolute relative error and correlation, indicate the accuracy of IDEAS for the estimation of linguistic units as compared with two conditions, namely, Oracle (manual diarization) and Voice Type Classifier (existing diarizer with acceptable accuracy). Results: The high F measure for SLP talk data suggests high accuracy of IDEAS diarization for SLP talk but less so for child talk. These differences are reflected in the accuracy of IDEAS linguistic unit estimates. IDEAS median absolute relative error and correlation values for nine of the 10 SLP linguistic unit estimates meet the accuracy criteria, but none of the child linguistic unit estimates meet these criteria. The type of linguistic units also affects IDEAS accuracy. Conclusions: IDEAS was tailored to educational settings to automatically convert audio recordings into text and to provide linguistic unit estimates in speech-language therapy sessions and classroom settings. Although not perfect, IDEAS is reliable in automatically capturing and returning linguistic units, especially in SLP talk, that are relevant in research and practice. The tool offers a way to automatically measure SLP talk in clinical settings, which will support research seeking to understand how SLP talk influences children's language growth.

Automat Parsing of Audio Recordings. Testing Children with Dyslalia. Theoretical Background

Automatic Recognition of Dyslalia Affecting Pre-Scholars

Vocal signal digital processing. Instrument for analog to digital conversion study

Software Package with Exercises for Therapy of Children with Dyslalia

Automation of Language Sample Analysis

Automatic Assessment of Language Background in Toddlers Through Phonotactic and Pitch Pattern Modeling of Short Vocalizations

An open-source voice type classifier for child-centered daylong recordings

Techniques and Challenges in Speech Synthesis

Exercises for Children with Dyslalia-Software Infrastructure

Language-Independent Approach for Automatic Computation of Vowel Articulation Features in Dysarthric Speech Assessment

Voice Disorder Analysis: a Transformer-based Approach

Accuracy of Automatic Processing of Speech-Language Pathologist and Child Talk During School-Based Therapy Sessions

Who Said What? An Automated Approach to Analyzing Speech in Preschool Classrooms

A Novel Application System of Assessing the Pronunciation Differences Between Chinese Children and Adults

DALI: a large Dataset of synchronized Audio, LyrIcs and notes, automatically created using teacher-student machine learning paradigm

On using the UA-Speech and TORGO databases to validate automatic dysarthric speech classification approaches

Design of English text-to-speech conversion algorithm based on machine learning

Exploiting ultrasound tongue imaging for the automatic detection of speech articulation errors

Multimodal Capture of Teacher-Student Interactions for Automated Dialogic Analysis in Live Classrooms

Audio Texture and Age-Wise Analysis of Disordered Speech in Children Having Specific Language Impairment

Error-preserving Automatic Speech Recognition of Young English Learners' Language