Abstract:Since the advent of modern computing, researchers have striven to make the human–computer interface (HCI) as seamless as possible. Progress has been made on various fronts, e.g., the desktop metaphor (interface design) and natural language processing (input). One area receiving attention recently is voice activation and its corollary, computer-generated speech. Despite decades of research and development, most computer-generated voices remain easily identifiable as non-human. Prosody in speech has two primary components—intonation and rhythm—both often lacking in computer-generated voices. This research aims to enhance computer-generated text-to-speech algorithms by incorporating melodic and prosodic elements of human speech. This study explores a novel approach to add prosody by using machine learning, specifically an LSTM neural network, to add paralinguistic elements to a recorded or generated voice. The aim is to increase the realism of computer-generated text-to-speech algorithms, to enhance electronic reading applications, and improved artificial voices for those in need of artificial assistance to speak. A computer that is able to also convey meaning with a spoken audible announcement will also improve human-to-computer interactions. Applications for the use of such an algorithm may include improving high-definition audio codecs for telephony, renewing old recordings, and lowering barriers to the utilization of computing. This research deployed a prototype modular platform for digital speech improvement by analyzing and generalizing algorithms into a modular system through laboratory experiments to optimize combinations and performance in edge cases. The results were encouraging, with the LSTM-based encoder able to produce realistic speech. Further work will involve optimizing the algorithm and comparing its performance against other approaches.

Excitation-based Voice Quality Analysis and Modification

Exploration of Audio Quality Assessment and Anomaly Localisation Using Attention Models

Voice quality analysis under the pitch effect

Amplitude Spectrum Based Excitation Model For Hmm-Based Speech Synthesis

Enhancing audio quality for expressive Neural Text-to-Speech

An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning

DCT_M Model for Excitation Parameter in Low Bit Rate Vocoder

An improved method for voice conversion based on Gaussian mixture model

Pitch-Scaled Spectrum Based Excitation Model for HMM-based Speech Synthesis

PMVC: Data Augmentation-Based Prosody Modeling for Expressive Voice Conversion

Automatic Speech Disentanglement for Voice Conversion using Rank Module and Speech Augmentation

Voice Conversion Based on Gaussian Mixture Modules with Minimum Distance Spectral Mapping

An Excitation Model Based On Inverse Filtering For Speech Analysis And Synthesis

Modifying Spectral Envelope to Synthetically Adjust Voice Quality and Articulation Parameters for Emotional Speech Synthesis

Extraction and Utilization of Excitation Information of Speech: A Review

End-to-End Voice Conversion with Information Perturbation

Converting Anyone's Voice: End-to-End Expressive Voice Conversion with a Conditional Diffusion Model

RAVE for Speech: Efficient Voice Conversion at High Sampling Rates

IQDUBBING: Prosody modeling based on discrete self-supervised speech representation for expressive voice conversion

Voice Synthesis Improvement by Machine Learning of Natural Prosody

Voice Disorder Analysis: a Transformer-based Approach