Abstract:State-of-the-art text-to-speech (TTS) synthesis models can produce monolingual speech with high intelligibility and naturalness. However, when the models are applied to synthesize code-switched (CS) speech, the performance declines seriously. Conventionally, developing a CS TTS system requires multilingual data to incorporate language-specific and cross-lingual knowledge. Recently, end-to-end (E2E) architecture has achieved satisfactory results in monolingual TTS. The architecture enables the training from one end of alphabetic text input to the other end of acoustic feature output. In this paper, we explore the use of E2E framework for CS TTS, using a combination of Mandarin and English monolingual speech corpus uttered by two female speakers. To handle alphabetic input from different languages, we explore two kinds of encoders: (1) shared multilingual encoder with explicit language embedding (LDE); (2) separated monolingual encoder (SPE) for each language. The two systems use identical decoder architecture, where a discriminative code is incorporated to enable the model to generate speech in one speaker's voice consistently. Experiments confirm the effectiveness of the proposed modifications on the E2E TTS framework in terms of quality and speaker similarity of the generated speech. Moreover, our proposed systems can generate controllable foreign-accented speech at character-level using only mixture of monolingual training data.

From Speech to Text in Chinese: A Computer-Aided Transcription System for the Legal Domain.

Automatic Conversion from Phonetic to Textual Representation of Cantonese : the Case of Hong Kong Court Proceedings.

Court Stenography-To-Text ("STT") in Hong Kong: A Jurilinguistic Engineering Effort

Statistically-based Model for Computer-Aided Transcription Application

Jurilinguistic engineering in Cantonese Chinese: an N-gram-based speech to text transcription system

Revisiting Judgment Translation in Hong Kong

A Bilingual Corpus in the Legal Domain and its Applications

A Study of Legal Translation from the Perspective of Error Analysis

Functional Approach to Training Translators for Legal Academic Writings

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

A Preliminary Study on Deep Learning-based Chinese Text to Taiwanese Speech Synthesis System

Better Transcription of UK Supreme Court Hearings

Report on English-Chinese Translation Practice Based on Trados Computer Aided Translation: A Case Study of Procedure in Civil Cases in the U.S. Courts

Computer based field investigation and processing system for languages

High Quality Terminology Alignment and Extraction 2 . 1 Bilingual Legal Terminology in Hong Kong

General Chinese Document Capture System with Improved Error-Rejecting Module

Design and Implementation of Chinese Common Braille Translation System Integrating Braille Word Segmentation and Concatenation Rules

HK-LegiCoST: Leveraging Non-Verbatim Transcripts for Speech Translation

Alignment and Extraction of Bilingual Legal Terminology from Context Profiles

Some Considerations on Guidelines for Bilingual Alignment and Terminology Extraction

Th-Ocr: System For Multilingual Document Analysis, Recognition And Reconstruction