Abstract:Voice conversion (VC) aims at conversion of speaker characteristic without altering content. Due to training data limitations and modeling imperfections, it is difficult to achieve believable speaker mimicry without introducing processing artifacts; performance assessment of VC, therefore, usually involves both speaker similarity and quality evaluation by a human panel. As a time-consuming, expensive, and non-reproducible process, it hinders rapid prototyping of new VC technology. We address artifact assessment using an alternative, objective approach leveraging from prior work on spoofing countermeasures (CMs) for automatic speaker verification. Therein, CMs are used for rejecting `fake' inputs such as replayed, synthetic or converted speech but their potential for automatic speech artifact assessment remains unknown. This study serves to fill that gap. As a supplement to subjective results for the 2018 Voice Conversion Challenge (VCC'18) data, we configure a standard constant-Q cepstral coefficient CM to quantify the extent of processing artifacts. Equal error rate (EER) of the CM, a confusability index of VC samples with real human speech, serves as our artifact measure. Two clusters of VCC'18 entries are identified: low-quality ones with detectable artifacts (low EERs), and higher quality ones with less artifacts. None of the VCC'18 systems, however, is perfect: all EERs are < 30 % (the `ideal' value would be 50 %). Our preliminary findings suggest potential of CMs outside of their original application, as a supplemental optimization and benchmarking tool to enhance VC technology.

Objective Distance Measures for Assessing Concatenative Speech Synthesis.

A Weighted Cepstral Distance Measure for Objective Quality Evaluation of Mandarin

The similaritymeasureamongacoustic models and its twoapplications

A novel unit selection method for concatenation speech system using similarity measure

THE SIMILARITY MEASURE AMONG ACOUSTIC MODELS AND ITS TWO APPLICATIONS

The Distance Measure for Line Spectrum Pairs Applied to Speech Recognition.

Evaluating Speech Synthesis by Training Recognizers on Synthetic Speech

Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR

A Novel Hybrid Mandarin Speech Synthesis System Using Different Base Units for Model Training and Concatenation

Comparison of Different Implementations of MFCC

Perceptual Clustering Based Unit Selection Optimization for Concatenative Text-to-speech Synthesis

A data driven method for target and concatenation cost calculation with KL-Divergence in Mandarin hybrid speech synthesis

A Spoofing Benchmark for the 2018 Voice Conversion Challenge: Leveraging from Spoofing Countermeasures for Speech Artifact Assessment.

HMM-based Unit Selection Speech Synthesis Using Log Likelihood Ratios Derived from Perceptual Data

Objective Evaluation Methods for Chinese Text-To-Speech Systems

Pronunciation recognition of English phonemes /\textipa{@}/, /æ/, /\textipa{A}:/ and /\textipa{2}/ using Formants and Mel Frequency Cepstral Coefficients

Towards a perceptual distance metric for auditory stimuli

MOSPC: MOS Prediction Based on Pairwise Comparison

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Voice Conversion Based on Gaussian Mixture Modules with Minimum Distance Spectral Mapping

A Log-Index Weighted Cepstral Distance Measure for Speech Recognition