Abstract:This paper proposed a novel speech processing algorithm in cochlear implant, which used harmonicity cues to enhance tonal information in Mandarin Chinese speech recognition. The input speech was filtered by a 4-channel band-pass filter bank. The frequency ranges for the four bands were: 300-621, 621-1285, 1285-2657, and 2657-5499 Hz. In each pass band, temporal envelope and periodicity cues (TEPCs) below 400 Hz were extracted by full wave rectification and low-pass filtering. The TEPCs were modulated by a sinusoidal carrier, the frequency of which was fundamental frequency (F0) and its harmonics most close to the center frequency of each band. Signals from each band were combined together to obtain an output speech. Mandarin tone, word, and sentence recognition in quiet listening conditions were tested for the extensively used continuous interleaved sampling (CIS) strategy and the novel F0-harmonic algorithm. Results found that the F0-harmonic algorithm performed consistently better than CIS strategy in Mandarin tone, word, and sentence recognition. In addition, sentence recognition rate was higher than word recognition rate, as a result of contextual information in the sentence. Moreover, tone 3 and 4 performed better than tone 1 and tone 2, due to the easily identified features of the former. In conclusion, the F0-harmonic algorithm could enhance tonal information in cochlear implant speech processing due to the use of harmonicity cues, thereby improving Mandarin tone, word, and sentence recognition. Further study will focus on the test of the F0-harmonic algorithm in noisy listening conditions.

Auditive Learning Based Chinese F0 Prediction

Clustering and Feature Learning Based F0 Prediction for Chinese Speech Synthesis

F0 Prediction Model of Speech Synthesis Based on Template and Statistical Method

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

A Superposed Prosodic Model for Chinese Text-To-Speech Synthesis

Modeling F0 Trajectories in Hierarchically Structured Deep Neural Networks.

Asynchronous F0 and Spectrum Modeling for HMM-based Speech Synthesis

Detection of Dynamic Structures of Speech Fundamental Frequency in Tonal Languages

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Generating Mandarin and Cantonese F0 Contours with Decision Trees and BLSTMs

Modeling DCT Parameterized F0 Trajectory at Intonation Phrase Level with DNN or Decision Tree

AUTOMATIC STRESS PREDICTION OF CHINESE SPEECH SYNTHESIS

A Hierarchical F0 Modeling Method for HMM-based Speech Synthesis

Learning Prosodic Patterns for Mandarin Speech Synthesis

An Optimized Neural Network Based Prosody Model of Chinese Speech Synthesis System

A novel speech processing algorithm for cochlear implant based on selective fundamental frequency control

Multi-Layer F0 Modeling for HMM-Based Speech Synthesis

A Novel Speech Processing Algorithm Based on Harmonicity Cues in Cochlear Implant

F0 Transformation for Emotional Speech Synthesis Using Target Approximation Features and Bidirectional Associative Memories

Effects of fundamental frequency contour on understanding Mandarin sentences in bimodal hearing simulations

Statistical modeling of syllable-level F0 features for HMM-based unit selection speech synthesis