Abstract:Perception with electric neuroprostheses is sometimes expected to be simulated using properly designed physical stimuli. Here, we examined a new acoustic vocoder model for electric hearing with cochlear implants (CIs) and hypothesized that comparable speech encoding can lead to comparable perceptual patterns for CI and normal hearing (NH) listeners. Speech signals were encoded using FFT-based signal processing stages including band-pass filtering, temporal envelope extraction, maxima selection, and amplitude compression and quantization. These stages were specifically implemented in the same manner by an Advanced Combination Encoder (ACE) strategy in CI processors and Gaussian-enveloped Tones (GET) or Noise (GEN) vocoders for NH. Adaptive speech reception thresholds (SRTs) in noise were measured using four Mandarin sentence corpora. Initial consonant (11 monosyllables) and final vowel (20 monosyllables) recognition were also measured. NaÏve NH listeners were tested using vocoded speech with the proposed GET/GEN vocoders as well as conventional vocoders (controls). Experienced CI listeners were tested using their daily-used processors. Results showed that: 1) there was a significant training effect on GET vocoded speech perception; 2) the GEN vocoded scores (SRTs with four corpora and consonant and vowel recognition scores) as well as the phoneme-level confusion pattern matched with the CI scores better than controls. The findings suggest that the same signal encoding implementations may lead to similar perceptual patterns simultaneously in multiple perception tasks. This study highlights the importance of faithfully replicating all signal processing stages in the modeling of perceptual patterns in sensory neuroprostheses. This approach has the potential to enhance our understanding of CI perception and accelerate the engineering of prosthetic interventions. The GET/GEN MATLAB program is freely available athttps://github.com/BetterCI/GETVocoder.

Neural Representation of Harmonic Single Sideband Encoder in Inferior Colliculus of Guinea Pigs

Beyond Auditory Relay: Dissecting the Inferior Colliculus’s Role in Sensory Prediction, Cognitive Decision-Making, and Reward Prediction

Neural Representation of Different Mandarin Tones in the Inferior Colliculus of the Guinea Pig.

Central Auditory Processing of Temporal and Spectral-Variance Cues in Cochlear Implant Listeners

A Novel Speech Processing Algorithm Based on Harmonicity Cues in Cochlear Implant

Temporal Coding of Voice Pitch Contours in Mandarin Tones.

Mandarin speech-in-noise and tone recognition using vocoder simulations of the temporal limits encoder for cochlear implants

Corticofugal Modulation of Temporal and Rate Representations in the Inferior Colliculus of the Awake Marmoset

A Hybrid Coding Strategy to Improve Auditory Perception of Cochlear Implant

Electric-Stimulus Rate Encoding Algorithm of Mandarin Tonal Information in Cochlear Implant

Representations of Time-Varying Cochlear Implant Stimulation in Auditory Cortex of Awake Marmosets (callithrix Jacchus)

Different Binaural Processing of the Envelope Component and the Temporal Fine Structure Component of a Narrowband Noise in Rat Inferior Colliculus

Population coding of time-varying sounds in the non-lemniscal Inferior Colliculus

[Objectively Evaluating Auditory Temporal Resolution by Iso-Modulation Depth Temporal Modulation Transfer Function in Inferior Colliculus and Auditory Cortex of Guinea Pigs].

Neuronal and behavioral discrimination between upward and downward pulse interval modulation in cochlea implanted gerbils

Neural Representations of Concurrent Sounds with Overlapping Spectra in Rat Inferior Colliculus: Comparisons Between Temporal-Fine Structure and Envelope.

Comparable Encoding, Comparable Perceptual Pattern: Acoustic and Electric Hearing.

Ensemble responses of auditory midbrain neurons in the cat to speech stimuli at different signal-to-noise ratios

Evaluating Cochlear Implant Stimulation Strategies Through Wide-field Calcium Imaging of the Auditory Cortex

Neural coding strategies in auditory cortex.

Near physiological spectral selectivity of cochlear optogenetics