Abstract:In this paper, we present WenetSpeech, a multi-domain Mandarin corpus consisting of 10000+ hours high-quality labeled speech, 2400+ hours weakly labeled speech, and about 10000 hours unlabeled speech, with 22400+ hours in total. We collect the data from YouTube and Podcast, which covers a variety of speaking styles, scenarios, domains, topics and noisy conditions. An optical character recognition (OCR) method is introduced to generate the audio/text segmentation candidates for the YouTube data on the corresponding video subtitles, while a high-quality ASR transcription system is used to generate audio/text pair candidates for the Podcast data. Then we propose a novel end-to-end label error detection approach to further validate and filter the candidates. We also provide three manually labelled high-quality test sets along with WenetSpeech for evaluation – Dev for cross-validation purpose in training, Test_Net, collected from Internet for matched test, and Test_Meeting, recorded from real meetings for more challenging mismatched test. Baseline systems trained with WenetSpeech are provided for three popular speech recognition toolkits, namely Kaldi, ESPnet, and WeNet, and recognition results on the three test sets are also provided as benchmarks. To the best of our knowledge, WenetSpeech is the current largest open-source Mandarin speech corpus with transcriptions, which benefits research on production-level speech recognition.

Collection of a Chinese Spontaneous Telephone Speech Corpus and Proposal of Robust Rules for Robust Natural Language Parsing

Robust Parsing in Spoken Dialogue Systems.

Spontaneous Speech Parsing in Travel Information Inquiring and Booking Systems

An Expressive Mandarin Speech Corpus

ROBUSTNESS OF SPEECH RECOGNITION AND CONSTRUCTION OF A SPEECH CORPUS

Corpus Construction for Aviation Speech Recognition

A Manually Annotated Chinese Corpus for Non-task-oriented Dialogue Systems

Robust Analysis And Interpretation Of Spoken Chinese Queries

A CANTONESE ACCENT CHINESE SPEECH CORPUS

Design of Speech Corpus for Mandarin Text to Speech

ATCSpeech: A Multilingual Pilot-Controller Speech Corpus from Real Air Traffic Control Environment

A corpus-based approach for cooperative response generation in a dialog system

An effective and robust approach to Mandarin spoken language understanding in specific domain

Building a Non-native Speech Corpus Featuring Chinese-English Bilingual Children: Compilation and Rationale

Grammatical Relations In Chinese: Gb-Ground Extraction And Data-Driven Parsing

Embedded Machine Learning Systems For Robust Spoken Language Parsing

Advancing Speech Translation: A Corpus of Mandarin-English Conversational Telephone Speech

WENETSPEECH: A 10000+ Hours Multi-Domain Mandarin Corpus for Speech Recognition

LSDSCC: a Large Scale Domain-Specific Conversational Corpus for Response Generation with Diversity Oriented Evaluation Metrics

KeSpeech: an Open Source Speech Dataset of Mandarin and Its Eight Subdialects.

TH-CoSS,a Mandarin Speech Corpus for TTS