Abstract:In this paper, an automatic and unsupervised method using context-dependent hidden Markov models (CD-HMMs) is proposed for the prosodic labeling of speech synthesis databases. This method consists of three main steps, i.e., initialization, model training and prosodic labeling. The initial prosodic labels are obtained by unsupervised clustering using the acoustic features designed according to the characteristics of the prosodic descriptor to be labeled. Then, CD-HMMs of the spectral parameters, Rh and phone durations are estimated by a means similar to the HMM-based parametric speech synthesis using the initial prosodic labels. These labels are further updated by Viterbi decoding under the maximum likelihood criterion given the acoustic feature sequences and the trained CD-HMMs. The model training and prosodic labeling procedures are conducted iteratively until convergence. The performance of the proposed method is evaluated on Mandarin speech synthesis databases and two prosodic descriptors are investigated, i.e., the prosodic phrase boundary and the emphasis expression. In our implementation, the prosodic phrase boundary labels are initialized by clustering the durations of the pauses between every two consecutive prosodic words, and the emphasis expression labels are initialized by examining the differences between the original and the synthetic F0 trajectories. Experimental results show that the proposed method is able to label the prosodic phrase boundary positions much more accurately than the text-analysis-based method without requiring any manually labeled training data. The unit selection speech synthesis system constructed using the prosodic phrase boundary labels generated by our proposed method achieves similar performance to that using the manual labels. Furthermore, the unit selection speech synthesis system constructed using the emphasis expression labels generated by our proposed method can convey the emphasis information effectively while maintaining the naturalness of synthetic speech.

Automatic Pitch-Synchronous Phonetic Segmentation with Context-Independent HMMs

Automatic Phonetic Segmentation Using HMM Model

Impact of Irregular Pronunciation on Phonetic Segmentation of Nijmegen Corpus of Casual Czech

Automatic Detection of the Temporal Segmentation of Hand Movements in British English Cued Speech

Using Prosody for Automatic Sentence Segmentation of Multi-party Meetings

Calibration of a two-state pitch-wise HMM method for note segmentation in Automatic Music Transcription systems

A Hierarchical Context-aware Modeling Approach for Multi-aspect and Multi-granular Pronunciation Assessment

Statistical Context-Dependent Units Boundary Correction for Corpus-based Unit-Selection Text-to-Speech

A Hybrid Approach for Co-Channel Speech Segregation based on CASA, HMM Multipitch Tracking, and Medium Frame Harmonic Model

Adaptive Frequency Cepstral Coefficients for Word Mispronunciation Detection

Unsupervised Prosodic Labeling Of Speech Synthesis Databases Using Context-Dependent Hmms

Improving Speech Enhancement Performance by Leveraging Contextual Broad Phonetic Class Information

Discriminative Training and Explicit Duration Modeling for HMM-based Automatic Segmentation

Bayesian Subspace Hidden Markov Model for Acoustic Unit Discovery

Automatic Segmentation for TTS Units

The Mason-Alberta Phonetic Segmenter: A forced alignment system based on deep neural networks and interpolation

Pitch discrimination in electric hearing with inconsistent and consistent amplitude-modulation and inter-pulse rate cues

PGSS: Pitch-Guided Speech Separation.

Automatic Pitch Accent Detection Using Auto-Context with Acoustic Features.

Competitive and Resource Efficient Factored Hybrid HMM Systems are Simpler Than You Think

Robust Phonetic Segmentation Using Spectral Transition measure for Non-Standard Recording Environments