Abstract:HMM-based automatic segmentation has been popularly used for corpus construction for concatenative speech synthesis. Since the most important reasons for the inaccuracy of HMM-based automatic segmentation are the HMM training criterion and duration control, we will study these particular issues. For the HMM training, we apply the discriminative training method and introduce a new criterion, named Minimum SeGmentation Error (MSGE). In this method, a loss function directly related to the segmentation error is defined, and parameter optimization is performed by the Generalized Probabilistic Descent (GPD) algorithm. For the duration control problem, we apply explicit duration models and propose a two-step-based segmentation method to solve the problem of computational cost, where the duration model is incorporated in a postprocessor procedure. From the experimental results, these two techniques significantly improve segmentation accuracy with different focuses, where the MSGE-based discriminative training focuses on improving the accuracy of sensitive boundary, i.e., a boundary where an error in segmentation is likely to cause a noticeable degradation in speech synthesis quality, and the explicit duration modeling focuses on eliminating large errors. After combining these two techniques, the error average was reduced from 6.86 ms to 5.79 ms on Japanese data, and from 8.67 ms to 6.61 ms on Chinese data. Simultaneously, the number of errors larger than 30 ms were reduced 25% and 51% on Chinese and Japanese data, respectively.

Audio Segmentation Based on Size-Fixed Window and Layer Detection

A Two-Stage Content-Based Audio Segmentation Algorithm

Audio Segmentation Based On Multi-Scale Audio Classification

A Novel Classification-Based Audio Segmentation Algorithm

Audio Segmentation in AAC Domain for Content Analysis

Efficient Audio Stream Segmentation Via the Combined T-2 Statistic and Bayesian Information Criterion

Speaker Segmentation Based on Between-Window Correlation over Speakers' Characteristics

An Improved Speaker Based Speech Segmentation Algorithm

Don't Discard Fixed-Window Audio Segmentation in Speech-to-Text Translation

Daubechies Wavelets Based Robust Audio Fingerprinting for Content-Based Audio Retrieval

A pitch-based rapid speech segmentation for speaker indexing

An Automatic Segmentation Method for Heart Sounds.

Automatic Segmentation for TTS Units

Automatic Segmentation of News Items Based on Video and Audio Features

Watermarking Algorithm Based on Audio Features and Smaller Values of Low Frequency Coefficients

A CIF-Based Speech Segmentation Method for Streaming E2E ASR

Multi-speaker Segmentation and Clustering of Telephone Speech

Discriminative Training and Explicit Duration Modeling for HMM-based Automatic Segmentation

Using Dtw Based Unsupervised Segmentation To Improve The Vocal Part Detection In Pop Music

Automatic segmentation of Chinese Mandarin speech into syllable-like

Audio splicing detection and localization using multistage filterbank spectral sketches and decision fusion