Abstract:Objectives: Watching a talker’s mouth is beneficial for speech reception (SR) in many communication settings, especially in noise and when hearing is impaired. Measures for audiovisual (AV) SR can be valuable in the framework of diagnosing or treating hearing disorders. This study addresses the lack of standardized methods in many languages for assessing lipreading, AV gain, and integration. A new method is validated that supplements a German speech audiometric test with visualizations of the synthetic articulation of an avatar that was used, for it is feasible to lip-sync auditory speech in a highly standardized way. Three hypotheses were formed according to the literature on AV SR that used live or filmed talkers. It was tested whether respective effects could be reproduced with synthetic articulation: (1) cochlear implant (CI) users have a higher visual-only SR than normal-hearing (NH) individuals, and younger individuals obtain higher lipreading scores than older persons. (2) Both CI and NH gain from presenting AV over unimodal (auditory or visual) sentences in noise. (3) Both CI and NH listeners efficiently integrate complementary auditory and visual speech features. Design: In a controlled, cross-sectional study with 14 experienced CI users (mean age 47.4) and 14 NH individuals (mean age 46.3, similar broad age distribution), lipreading, AV gain, and integration of a German matrix sentence test were assessed. Visual speech stimuli were synthesized by the articulation of the Talking Head system “MASSY” (Modular Audiovisual Speech Synthesizer), which displayed standardized articulation with respect to the visibility of German phones. Results: In line with the hypotheses and previous literature, CI users had a higher mean visual-only SR than NH individuals (CI, 38%; NH, 12%; p < 0.001). Age was correlated with lipreading such that within each group, younger individuals obtained higher visual-only scores than older persons (rCI = −0.54; p = 0.046; rNH = −0.78; p < 0.001). Both CI and NH benefitted by AV over unimodal speech as indexed by calculations of the measures visual enhancement and auditory enhancement (each p < 0.001). Both groups efficiently integrated complementary auditory and visual speech features as indexed by calculations of the measure integration enhancement (each p < 0.005). Conclusions: Given the good agreement between results from literature and the outcome of supplementing an existing validated auditory test with synthetic visual cues, the introduced method can be considered an interesting candidate for clinical and scientific applications to assess measures important for AV SR in a standardized manner. This could be beneficial for optimizing the diagnosis and treatment of individual listening and communication disorders, such as cochlear implantation.

SVANTE – The Swedish Articulation and Nasality Test – Normative data and a minimum standard set for cross-linguistic comparison

Reliability of Variables of Consonant Production and Velopharyngeal Competence in 10-year-olds with Cleft Palate Using Multiple Raters

Affective state and voice: cross-cultural assessment of speaking behavior and voice sound characteristics--a normative multicenter study of 577 + 36 healthy subjects

Persisting speech difficulties at 7–8 years of age – a longitudinal study of speech production in internationally adopted children with cleft lip and palate

Evaluating normalization accounts against the dense vowel space of Central Swedish

Pediatric normative data for a novel and fast speech perception test in noise

Cross-Linguistic Nasalance Comparisons: A Review of Speech Sample Sets and Preliminary Consideration of Effect of Lexical Tone

Normative data for diagnosing auditory processing disorder in Norwegian children aged 7–12 years

An Evaluation of the Psychometric Properties of the Short Form of the Speech, Spatial and Qualities of Hearing Scale in Swedish: Online Versus Paper-and-Pen

Age Norms for Auditory-Perceptual Neurophonetic Parameters: A Prerequisite for the Assessment of Childhood Dysarthria

[Singing Voice Handicap Index-12 : Development and validation of a German version]

Producing Nasal Vowels Without Nasalization? Perceptual Judgments and Acoustic Measurements of Nasal/Oral Vowels Produced by Children With Cochlear Implants and Typically Hearing Peers

Prosody and schizophrenia. Objective acoustic measurements of monotonous and flat intonation in young Danish people with a schizophrenia diagnosis. A pilot study

Validating a Method to Assess Lipreading, Audiovisual Gain, and Integration During Speech Reception With Cochlear-Implanted and Normal-Hearing Subjects Using a Talking Head

Comparative study of three methods on assessing velopharyngeal function

When No Speech Norms Exist: Observations From Sinhala

The Normative Study of Acoustic and Aerodynamic Characteristics of Voice among Healthy Adult Turkish Speaker Population

Productions of Goldman-Fristoe Test of Articulation–Third Edition Stimulus Words Among Teenage Speakers of Anguillian Eastern Caribbean English

Using Artificial Intelligence for Assessment of Velopharyngeal Competence in Children Born With Cleft Palate With or Without Cleft Lip

Development of Singapore English speech audiometry test materials

Who is Right? A Word-Identification-in-Noise Test for Young Children Using Minimal Pair Distracters