Abstract:Accurate pitch extraction from speech is important but challenging problem for speech synthesis. However, the additive nature and long-term suprasegmental property of pitch features have not been fully exploited in most of the existing pitch estimators as they are operated frame by frame. As a result, they would cause some inherent discontinuities, such as double/half F0 errors and unvoiced/voiced (U/V) error. This would adversely affect the quality of synthetic speech as well as the expressiveness of the prosody information. In this paper, we explore the novel use of multi-tasks (Task 1: U/V; Task 2: Pitch) bidirectional long short-term memory recurrent neural network (BLSTM) to model the pitch and voicing decision simultaneously in a unified framework. The features used in this study are extracted from the frequency domain. We compute the log-frequency power spectrogram and then normalize to the long-term speech spectrum to attenuate noises. A filter is then used to enhance the harmonicity. Experiments show that the proposed approach substantially outperforms RAPT, which behaves the best in clean condition. Besides, our proposed approach can even work well with a certain level of background noise.

Research on Estimation of Pitch Period OF MBE Vocoder

Multiband Excitation Coding of Speech at 1.8 ～ 2.4 Kbps

Adaptive two-direction pitch tracking algorithm for MBE vocoder

Research on MBE Algorithm at Bit Rate 800 Bps-2.4 Kbps Vocoder

Improved Algorithm for Pitch Period Detection

Investigation of the Spectral Envelope Estimation Vocoder and Improved Pitch Estimation Based on the Sinusoidal Speech Model

Improved two-path pitch tracking algorithm for multiband excitation vocoders

New speech synthesis algorithm based on MBE

Simulation of the Multiband Excitation Encoder

An Improved 2.4kb/s Mixed Excitation Linear Prediction Vocoder

Speech Synthesis with Optimal Phase Design for MBE Vocoder

An initial research: Towards accurate pitch extraction for speech synthesis based on BLSTM

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

An Improved Pitch Period Estimation Cepstrum Algorithm Combined Linear Prediction and Sliding Window Smoothing

High performance mandarin pitch estimation

Research on real time low bit-rate speech coding

A Pitch Estimation Algorithm Based on the Variance Analysis

Research on analysis and optimization of MBE

Prosody Modification for Vocoder Based on Amplitude Spectrum of Residual Signal

A New Method for Accurate Pitch Period Measurement

A High Quality MBE-LPC-FE Speech Coder at 2.4 Kbps and 1.2 Kbps.