Abstract:OBJECTIVES: Fundamental frequency (F0) information is important to Chinese tone and speech recognition. Cochlear implant (CI) speech processors typically provide limited F0 information via temporal envelopes delivered to stimulating electrodes. Previous studies have shown that English-speaking CI users' speech performance is correlated with amplitude modulation detection thresholds (AMDTs). The present study investigated whether Chinese-speaking CI users' speech performance (especially tone recognition) is correlated with temporal processing capabilities.DESIGN: Chinese tone, vowel, consonant, and sentence recognition were measured in 10 native Mandarin-speaking CI users via clinically assigned speech processors. AMDTs were measured in the same subjects for 20- and 100-Hz amplitude modulated (AM) stimuli presented to a middle electrode at five stimulation levels that spanned the dynamic range. To further investigate the CI users' sensitivity to temporal envelope cues, AM frequency discrimination thresholds (AMFDTs) were measured for two standard AM frequencies (50 and 100 Hz), presented to the same middle electrode at 30% and 70% dynamic range with a fixed modulation depth (50%).RESULTS: Results showed that AMDTs significantly improved with increasing stimulation level and that individual subjects exhibited markedly different AMDT functions. AMFDTs also improved with increasing stimulation level and were better with the 100-Hz standard AM frequency than with the 50-Hz standard AM frequency. Statistical analyses revealed that both mean AMDTs (averaged for 20- or 100-Hz AM across all stimulation levels) and mean AMFDTs (averaged for the 50-Hz standard AM frequency across both stimulation levels) were significantly correlated with tone, consonant, and sentence recognition scores, but not with vowel recognition scores. Mean AMDTs were also significantly correlated with mean AMFDTs.CONCLUSIONS: These preliminary results, obtained from a limited number of subjects, demonstrate the importance of temporal processing to CI speech recognition. The results further suggest that CI users' Chinese tone and speech recognition may be improved by enhancing temporal envelope cues delivered by speech processing algorithms.

EEG-based assessment of temporal fine structure and envelope effect in mandarin syllable and tone perception

Cortical encoding of acoustic and linguistic rhythms in spoken narratives

Acoustic Correlates of the Syllabic Rhythm of Speech: Modulation Spectrum or Local Features of the Temporal Envelope

Robust Cortical Entrainment to the Speech Envelope Relies on the Spectro-Temporal Fine Structure

[The Neural Encoding of Continuous Speech - Recent Advances in EEG and MEG Studies].

Neural Tracking of Sound Rhythms Correlates with Diagnosis, Severity, and Prognosis of Disorders of Consciousness

Auditory attention decoding from EEG-based Mandarin speech envelope reconstruction

Recognizing Tonal and Non-Tonal Mandarin Sentences for EEG-based Brain-Computer Interface

Recognizing Tonal and Nontonal Mandarin Sentences for EEG-Based Brain–Computer Interface

Characterizing Neural Entrainment to Hierarchical Linguistic Units using Electroencephalography (EEG).

Differential weighting of temporal envelope cues from the low-frequency region for Mandarin sentence recognition in noise

Mandarin Tone Recognition from Brain Dynamics

Speech Recognition and Temporal Amplitude Modulation Processing by Mandarin-Speaking Cochlear Implant Users

Cortical entrainment to continuous speech: functional roles and interpretations.

Temporal Structures of English and Mandarin Running Speech

Effects of the Temporal Fine Structure in Different Frequency Bands on Mandarin Tone Perception

Relative Weights of Temporal Envelope Cues in Different Frequency Regions for Mandarin Vowel, Consonant, and Lexical Tone Recognition

Robust EEG-Based Decoding of Auditory Attention With High-RMS-Level Speech Segments in Noisy Conditions

Speech decoding using cortical and subcortical electrophysiological signals

The Relative Weight of Temporal Envelope Cues in Different Frequency Regions for Mandarin Disyllabic Word Recognition

Characteristics of different Mandarin pronunciation element perception: evidence based on a multifeature paradigm for recording MMN and P3a components of phonemic changes in speech sounds