Abstract:Since the advent of modern computing, researchers have striven to make the human–computer interface (HCI) as seamless as possible. Progress has been made on various fronts, e.g., the desktop metaphor (interface design) and natural language processing (input). One area receiving attention recently is voice activation and its corollary, computer-generated speech. Despite decades of research and development, most computer-generated voices remain easily identifiable as non-human. Prosody in speech has two primary components—intonation and rhythm—both often lacking in computer-generated voices. This research aims to enhance computer-generated text-to-speech algorithms by incorporating melodic and prosodic elements of human speech. This study explores a novel approach to add prosody by using machine learning, specifically an LSTM neural network, to add paralinguistic elements to a recorded or generated voice. The aim is to increase the realism of computer-generated text-to-speech algorithms, to enhance electronic reading applications, and improved artificial voices for those in need of artificial assistance to speak. A computer that is able to also convey meaning with a spoken audible announcement will also improve human-to-computer interactions. Applications for the use of such an algorithm may include improving high-definition audio codecs for telephony, renewing old recordings, and lowering barriers to the utilization of computing. This research deployed a prototype modular platform for digital speech improvement by analyzing and generalizing algorithms into a modular system through laboratory experiments to optimize combinations and performance in edge cases. The results were encouraging, with the LSTM-based encoder able to produce realistic speech. Further work will involve optimizing the algorithm and comparing its performance against other approaches.

EasyVoice: Integrating voice synthesis with Skype

How can we test seesaw experimentally?

Voice Assistant for Blind Person

Make-A-Voice: Unified Voice Synthesis With Discrete Representation

VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing

Using Voice Technologies to Support Disabled People

Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation

Voice Synthesis Improvement by Machine Learning of Natural Prosody

OpenVoice: Versatile Instant Voice Cloning

Low-Cost Human-Machine Interface for Computer Control with Facial Landmark Detection and Voice Commands

An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning

VoCopilot: Voice-Activated Tracking of Everyday Interactions

Towards Streaming Speech-to-Avatar Synthesis

Voice Cloning Using Artificial Intelligence and Machine Learning: A Review

Seeing Your Speech Style: A Novel Zero-Shot Identity-Disentanglement Face-based Voice Conversion

Empowering Communication: Speech Technology for Indian and Western Accents through AI-powered Speech Synthesis

SuperVoice: Text-Independent Speaker Verification Using Ultrasound Energy in Human Speech

Enabling Private and Non-Intrusive Smartphone Calls with LipTalk

FaceChat: An Emotion-Aware Face-to-face Dialogue Framework

Advancing Voice Biometrics for Dysarthria Speakers Using Multitaper LFCC and Voice Conversion Data Augmentation

VoiceLoop: Voice Fitting and Synthesis via a Phonological Loop