Abstract:Research efforts in the field of TTS have placed emphasis on the naturalness in synthesized speech to facilitate various applications in Human-Computer Interaction (HCI). The ideal synthetic speech for HCI should not only have proper pronunciations, but also convey the appropriate semantics within the context of use. "Context" refers to the textual context of the document, the identity of the interlocutors in the interactive conversation, the application scenarios, etc. For example, synthetic speech for news reports may adopt lucid and smooth characters while sports commentaries may call for a more animated character. This paper focuses on expressive text-to-speech synthesis. Expressions in speech encompass many elements. Our work focuses on emotional and stylized synthetic speech in synthesizing speech. Emotion originates from the speakers' psychological and physical states and is realized through spectral and prosodic parameters. Style is dependent on the semantics of the spoken message and the conversation scenarios so that it can be realized with global prosodic features. Emotion and style are also interdependent. In general, emotion has relatively local effects and its acoustic parameters are more dynamic while style has relatively global effects and its acoustic parameters are more stable in the speech signals. Emotion and style thus jointly modify the acoustic features of the speech signal for more affective and effective conveyance of the underlying message. Thus a TTS system that can simulate different emotions and styles will make HCI more natural and desirable.

SSML Extensions for Chinese Voice Browsing

A Unified Framework for Multilingual Text-to-speech Synthesis with SSML Specification As Interface

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

Improving TTS for Shanghainese: Addressing Tone Sandhi via Word Segmentation

Improving Prosody with Linguistic and Bert Derived Features in Multi-Speaker Based Mandarin Chinese Neural TTS

BiSinger: Bilingual Singing Voice Synthesis

Mandarin-English Mixed TTS Based on HCSIPA

HMM Based TTS for Mixed Language Text.

Modeling the Expressivity of Input Text Semantics for Chinese Text-to-Speech Synthesis in a Spoken Dialog System

A New Chinese Text-to-speech System with High Naturalness

Mandarin-English Mixed Text to Speech Based on HCSIPA

Label Transform Based Cross-Language Speaker Adaptation in Bilingual (Mandarin-English) TTS

Toward Synthesizing Expressive Mandarin Speech

Modeling Prosody Patterns for Chinese Expressive Text-to-speech Synthesis

Improve Bilingual TTS Using Dynamic Language and Phonology Embedding

A Cascade Sequence-to-Sequence Model for Chinese Mandarin Lip Reading.

Bailing-TTS: Chinese Dialectal Speech Synthesis Towards Human-like Spontaneous Representation

Text Enhancement for Paragraph Processing in End-to-End Code-switching TTS

FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs

An HMM-based Cantonese speech synthesis system

Text-To-Visual Speech in Chinese Based on Data-Driven Approach