Abstract:In this paper, we propose parameter generation methods using rich context models as yet another hybrid method combining Hidden Markov Model (HMM)-based speech synthesis and unit selection synthesis. Traditional HMM-based speech synthesis enables flexible modeling of acoustic features based on a statistical approach. However, the speech parameters tend to be excessively smoothed. To address this problem, several hybrid methods combining HMM-based speech synthesis and unit selection synthesis have been proposed. Although they significantly improve quality of synthetic speech, they usually lose flexibility of the original HMM-based speech synthesis. In the proposed methods, we use rich context models, which are statistical models that represent individual acoustic parameter segments. In training, the rich context models are reformulated as Gaussian Mixture Models (GMMs). In synthesis, initial speech parameters are generated from probability distributions over-fitted to individual segments, and the speech parameter sequence is iteratively generated from GMMs using a parameter generation method based on the maximum likelihood criterion. Since the basic framework of the proposed methods is still the same as the traditional framework, the capability of flexibly modeling acoustic features remains. The experimental results demonstrate: (1) the use of approximation with a single Gaussian component sequence yields better synthetic speech quality than the use of EM algorithm in the proposed parameter generation method, (2) the state-based model selection yields quality improvements at the same level as the frame-based model selection, (3) the use of the initial parameters generated from the over-fitted speech probability distributions is very effective to further improve speech quality, and (4) the proposed methods for spectral and $F_{0}$ components yields significant improvements in synthetic speech quality compared with the traditional HMM-based speech synthesis.

Parameter Sharing in Speech Recognition

Fuzzy Parameter Clustering Method In Speech Recognition

Fuzzy C-Means Clustering Based Phonetic Tied-Mixture HMM in Speech Recognition

Parametric model of introducing inter-frame correlation information into hidden markov model for speech recognition

Speech Recognition Using Speaker Adaptation by System Parameter Transformation.

An Appropriate Parallel HMM for Speaker-Independent Speech Recognition

Minimum Kullback–Leibler Divergence Parameter Generation for HMM-Based Speech Synthesis

A Fuzzy-Clustering Analysis Based on Phonetic Tied-Mixture HMM

Speaker-independent speech recognition based on HMM state-restructuring method

Parameter-efficient Dysarthric Speech Recognition Using Adapter Fusion and Householder Transformation

Hierarchical Parameter Sharing In Recursive Neural Networks With Long Short-Term Memory

Understanding Parameter Sharing in Transformers

Parameter Generation Methods With Rich Context Models for High-Quality and Flexible Text-To-Speech Synthesis

A Novel Information Integration Algorithm for Speech Recognition System: Basing on Adaptive Clustering and Supervised State of Acoustic Feature

Latent Correlation Analysis of HMM Parameters for Speech Recognition

Speech recognition adaptive clustering feature extraction algorithms based on the k-means algorithm and the normalized intra-class variance

Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing

Integrating Articulatory Features into HMM-Based Parametric Speech Synthesis

Application of Hidden Markov Models in Speech Command Recognition

A Quick and Effective Speaker Diarization System.

From Linear Prediction HMM to a New Combined Model for Speech Recognition