Abstract:This paper proposes to select frame-sized speech segments for waveform concatenation speech synthesis using neural network based acoustic models. First, a deep neural network (DNN) based frame selection method is presented. In this method, three DNNs are adopted to calculate target costs and concatenation costs respectively for selecting candidate frames of 5ms length. One DNN is built in the same way as the DNN-based statistical parametric speech synthesis, which predicts target acoustic features given linguistic context inputs. The distance between the acoustic features of a candidate unit and the predicted ones for a target unit is calculated as the target cost. The other two DNNs are constructed to predict the acoustic features at current frame using its context features and the acoustic features of preceding frames. At synthesis time, these two DNNs are employed to calculate the concatenation cost for each candidate frame given its preceding ones. Furthermore, recurrent neural networks (RNNs) with long short-term memory (LSTM) cells are adopted to replace DNNs for acoustic modeling in order to make better use of the sequential information. A strategy of using multi-frame instead of single frame as the basic unit for selection is also presented to reduce the concatenation points within synthetic speech. Experimental results show that our proposed method can achieve better naturalness than the hidden Markov model (HMM)-based frame selection method and the HMM-based parametric speech synthesis method.

Trainable Unit Selection Speech Synthesis under Statistical Framework

Statistical Acoustic Model Based Unit Selection Algorithm for Speech Synthesis

Unit Selection Speech Synthesis Integrating Automatic Error Detection

Improved unit selection speech synthesis method utilizing subjective evaluation results on synthetic speech

Optimization Method for Unit Selection Speech Synthesis Based on Synthesis Quality Predictions

Building HMM based unit-selection speech synthesis system using synthetic speech naturalness evaluation score

Minimum Unit Selection Error Training for HMM-based Unit Selection Speech Synthesis System

HMM-based Unit Selection Speech Synthesis Using Log Likelihood Ratios Derived from Perceptual Data

Statistical modeling of syllable-level F0 features for HMM-based unit selection speech synthesis

Hybrid Unit Model Based Non-uniform Unit Selection

HMM-based Unit Selection Using Frame Sized Speech Segments.

Stable boundary-based non-uniform unit selection in speech synthesis

Restricted Boltzmann Machine Based Spectrum Modeling and Unit Selection Speech Synthesis Method

HMM-based Unit Selection Using F

Automatic Generation Of Synthesis Units For Trainable Text-To-Speech Systems

HMM-Based Hierarchical Unit Selection Combining Kullback-Leibler Divergence with Likelihood Criterion

Hierarchical Non-Uniform Unit Selection Based on Prosodic Structure

A novel unit selection method for concatenation speech system using similarity measure

Automatic Error Detection For Unit Selection Speech Synthesis Using Log Likelihood Ratio Based Svm Classifier

Selecting optimal non-uniform units for hierarchical unit selection

Unit Selection Speech Synthesis Using Frame-Sized Speech Segments and Neural Network Based Acoustic Models