Abstract:In this study, we present an innovative technique for speaker adaptation in order to improve the accuracy of segmentation with application to unit-selection Text-To-Speech (TTS) systems. Unlike conventional techniques for speaker adaptation, which attempt to improve the accuracy of the segmentation using acoustic models that are more robust in the face of the speaker's characteristics, we aim to use only context dependent characteristics extrapolated with linguistic analysis techniques. In simple terms, we use the intuitive idea that context dependent information is tightly correlated with the related acoustic waveform. We propose a statistical model, which predicts correcting values to reduce the systematic error produced by a state-of-the-art Hidden Markov Model (HMM) based speech segmentation. Our approach consists of two phases: (1) identifying context-dependent phonetic unit classes (for instance, the class which identifies vowels as being the nucleus of monosyllabic words); and (2) building a regression model that associates the mean error value made by the ASR during the segmentation of a single speaker corpus to each class. The success of the approach is evaluated by comparing the corrected boundaries of units and the state-of-the-art HHM segmentation against a reference alignment, which is supposed to be the optimal solution. In conclusion, our work supplies a first analysis of a model sensitive to speaker-dependent characteristics, robust to defective and noisy information, and a very simple implementation which could be utilized as an alternative to either more expensive speaker-adaptation systems or of numerous manual correction sessions.

Refining segmental boundaries for TTS database using fine contextual-dependent boundary models

Context-Dependent Boundary Model for Refining Boundaries Segmentation of TTS Units

Refining phoneme segmentations using speaker-adaptive context dependent boundary models.

Automatic Segmentation for TTS Units

Improving Image Segmentation with Boundary Patch Refinement

Discriminative Training and Explicit Duration Modeling for HMM-based Automatic Segmentation

XLS-R fine-tuning on noisy word boundaries for unsupervised speech segmentation into words

A realistic and robust model for Chinese word segmentation

Automatic Phrase Boundary Labeling for Mandarin TTS Corpus Using Context-Dependent HMM.

Statistical Context-Dependent Units Boundary Correction for Corpus-based Unit-Selection Text-to-Speech

Prosodic Word Boundaries Prediction for Mandarin Text-to-Speech

Automatic segmentation of Chinese Mandarin speech into syllable-like

Mining Word Boundaries in Speech as Naturally Annotated Word Segmentation Data

Segmenting Subtitles for Correcting ASR Segmentation Errors

Unsupervised Prosodic Phrase Boundary Labeling Of Mandarin Speech Synthesis Database Using Context-Dependent Hmm

Automatic Phrase Boundary Labeling of Speech Synthesis Database Using Context-Dependent HMMs and N-Gram Prior Distributions

Segment, Mask, and Predict: Augmenting Chinese Word Segmentation with Self-Supervision

Automatic Conversion from Lexical Words to Prosodic Words for Mandarin Text-to-speech System

Semi-continuous Segmental Probability Modeling for Continuous Speech Recognition.

EtC: Temporal Boundary Expand then Clarify for Weakly Supervised Video Grounding with Multimodal Large Language Model

A hybrid Chinese word segmentation model for quality management-related texts based on transfer learning