Mandarin Continuous Digit Speech Recognition System

xu haitian,wu ji,wang zuoying

DOI: https://doi.org/10.3321/j.issn:1002-8331.2002.02.034

2002-01-01

Abstract:Mandarin Continuous Digit Speech Recogniton takes up an important position in the development of speech recognition.In this paper,a system is implemented to reduce confusion.Then modeling improvement and audio speed controlling are introduced,which give our system good performance.

What problem does this paper attempt to address?

High Performance Digit Mandarin Speech Recognition

李虎生,刘加,刘润生

DOI: https://doi.org/10.3321/j.issn:0372-2112.2001.05.005

2000-01-01

Abstract:High performance mandarin digit speech recognition (MDSR) system is developed using MFCC (mel frequency cepstrum coefficient) as the main parameter identifying the speech patterns. The formant trajectory and the nasal feature are extracted to identify confused words. A feature based, real time endpoint detection algorithm is proposed to reduce the system resource requirements and to improve the disturbance proof ability. A two stage recognition frame enhances discrimination by identifying candidate words in the first stage and confused word pairs in the second stage. These improvements result in a correct recognition rate of 98.8%.
Design and implementation of a speaker recognition system

韩雁,陈利华

DOI: https://doi.org/10.3785/j.issn.1008-973X.2001.02.011

2001-01-01

Abstract:After a various of comparison among possible speech processingapproaches, we present and developed a speaker recognition system(SRS). The six Chinese single vowels are selected as the test elements of our models. The computer speech analysis techniques adopted in this system include short-time power and short-time average zero-cross rate test, cepstrum analysis and linear prediction coding, which are used to detect the start-end points of speech and to get the characteristic parameters of the speaker. This system is implemented under MATLAB and Windows environment and has perfect recognition results.
Algorithm for Mandarin Continuous Speech Recognition Based on Context-Dependent Unit Between Syllables

ZHAO Qingwei,WANG Zuoying,LU Dajin

DOI: https://doi.org/10.3321/j.issn:1000-0054.1999.09.018

1999-01-01

Abstract:In order to improve the performence of the recognition system for mandarin continuous speech, the context dependent units between syllables need to be constructed, and the recognition algorithm need to be studied. The theory of the mandarin continuous speech recognition based on DDBHMM and maximum a posterior estimation principle was discussed. And on the basis of this theory, in terms of the principles of dynamic programming, an algorithm for continuous speech recognition was proposed based on the context dependent unit between syllables. According to this algorithm, not only the optimal sentence candidate was obtained, but also the data structure of syllable lattice (that is the N best candidates) was obtained. At last, the error rate of the recognition system using the context dependent unit is reduced greatly in contrast to the system using the context independent unit.
An Efficient Computation Algorithm In Mandarin Continuous Speech Recognition

Ji Wu,Zuoying Wang

IF: 1.019

2002-01-01

Chinese Journal of Electronics

Abstract:In speech recognition systems based on continuous density HMM, the distance computation is an intensive task. A fast algorithm named ICEVQ (Inverse Covariance Matrix Eigenvector Vector Quantization) is proposed in this paper, which implements a two-pass strategy to simplify the distance computation. Experiments employing this algorithm show the significant computation reduction (up to an order of 6) on testing corpus without obvious degradation in recognition accuracy.
Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

Qingwei Zhao,Zuoying Wang,Dajin Lu

1998-01-01

Abstract:In this paper we present the algorithm on building inter-syllable context dependent unit for Mandarin continuous speech recognition, in order to avoid coarticulation effects. Firstly the clustering algorithm based on decision tree is introduced, which make full use of the phonological rules. On the basis of information theory, the splitting measurement of the clustering algorithm is studied, which is the difference in entropy result from model splitting. Then the recognition algorithm based on the inter-syllable context-dependent unit is presented, which is based on the principles of dynamic programming. At last, the speaker independent large vocabulary Mandarin continuous speech recognition experiment is discussed. It shows that, the error rate of the recognition system using the context-dependent unit is reduced more than 15% in contrast to the system using the context-independent unit, which reveals the good performance of the new unit.
Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Sheng Qiang,Yao Qian,Frank K. Soong,Congfu Xu

DOI: https://doi.org/10.21437/interspeech.2007-503

2007-01-01

Abstract:The F0 contour plays an important role in recognizing spoken tonal languages like Mandarin Chinese. However, the discontinuity of F0 between voiced and unvoiced transition has traditionally been a bottleneck in creating a succinct statistical tone model for automatic speech recognition applications. By applying successfully the Multi-Space Distribution (MSD) to tone modeling, we recently reported a relative 24% reduction of tonal syllable errors on a Mandarin speech database. In this paper, we test MSD further in a noisy, continuous Mandarin digit recognition task, where eight types of noises are added to clean speech signals at five SNRs. The experimental results show that our MSD-based digit models can significantly improve the recognition performance in noise over a baseline system. Relative digit error rate reductions of 19.1% and 15.0% are obtained for noises seen and unseen in the training data, respectively. The improvements are also better than other reference systems where F0 information is incorporated.
Feature Selection In Mandarin Large Vocabulary Continuous Speech Recognition

X Zhu,Yn Chen,J Liu,Rs Liu

DOI: https://doi.org/10.1109/ICOSP.2002.1181104

2002-01-01

Abstract:In this paper, three kinds of important features in speech recognition are introduced, including LPCC, MFCC and PLP. In order to compare the performances of these features, we design detailed experiments about the feature selection in a mandarin large vocabulary continuous speech recognition system. In this system the semi-syllable based CHMM is applied to establish speech models and the all-syllables recognition accuracy is adopted to represent the performance. By employing. different kinds. of features, comparing diverse dimensions. and selecting the computation methods of energy features, we utilize 45-dimension MF-PLP features in mandarin speech recognition system for the first time and obtain the best all-syllables recognition accuracy in published documents.
An Improved Linear Discriminant Analysis for Mandarin Digit Speech Recognition

史媛媛,刘加,刘润生

DOI: https://doi.org/10.3321/j.issn:0372-2112.2002.07.007

2002-01-01

Abstract:It is found that the phonetic similarities in the Mandarin digits are the main reasons for the difficulty of Mandarin digit recognition.In this paper,an improved linear discriminant analysis (LDA) based on the states of hidden Markov models (HMM) is presented.The recognition model discriminability is greatly improved by gathering the confusion data to the given states and then using the state-specific discriminative transformation.The experiments show that it increases the recognition rate greatly even if the simple models with insufficient states are used.The recognition accuracy of isolated Mandarin digits is over 99.32% after using optimal linear discriminative transformation.
A System for Mandarin Short Phrase Recognition on Portable Devices

C Xu,Y Liu,YS Yang,P Fung,ZG Cao

DOI: https://doi.org/10.1109/chinsl.2004.1409628

2004-01-01

Abstract:With the proliferation of portable devices, speech recognition, especially name, address and command recognition, on these devices is a topic of growing relevance. A Mandarin short phrase recognition system is introduced in consideration of the limited resources and calculation ability of portable devices. A fixed-point front-end is developed, a discrete hidden Markov model is employed for acoustic modeling, and an SNR based likelihood weighting method is proposed to improve the noise robustness of the system. The memory size of the model set is 269 kB, the decoding time is 0.89 times of the speech duration, and the method for robustness gives a relative 15.2% word error rate reduction in a complex practical environment with both channel distortion and non-stationary noise present.
Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Shiliang Zhang,Ming Lei,Yuan Liu,Wei Li

DOI: https://doi.org/10.1109/icassp.2019.8683859

2019-01-01

Abstract:The choice of acoustic modeling units is critical to acoustic modeling in large vocabulary continuous speech recognition (LVCSR) tasks. The recent connectionist temporal classification (CTC) based acoustic models have more options for the choice of modeling units. In this work, we propose a DFSMN-CTC-sMBR acoustic model and investigate various modeling units for Mandarin speech recognition. In addition to the commonly used context-independent Initial/Finals (CI-IF), context-dependent Initial/Finals (CD-IF) and Syllable, we also propose a hybrid Character-Syllable modeling units by mixing high frequency Chinese characters and syllables. Experimental results show that DFSMN-CTC-sMBR models with all these types of modeling units can significantly outperform the well-trained conventional hybrid models. Moreover, we find that the proposed hybrid Character-Syllable modeling units is the best choice for CTC based acoustic modeling for Mandarin speech recognition in our work since it can dramatically reduce substitution errors in recognition results. In a 20,000 hours Mandarin speech recognition task, the DFSMN-CTC-sMBR system with hybrid Character-Syllable achieves a character error rate (CER) of 7.45% while performance of the well-trained DFSMN-CE-sMBR system is 9.49%.
High Performance Mandarin Digit Recognition System on a DSP Chip

董明,刘加,刘润生

DOI: https://doi.org/10.3321/j.issn:1000-0054.2003.09.028

2003-01-01

Abstract:Highperformance Mandarin digital speech recognition (MDSR) systems on embedded platforms are needed by many industries such as for telecommunications and automatic control. A highperformance MDSR system was implemented on a 16bit fixedpoint DSP. The system uses the Mel frequency cepstrum coefficient parameter as the main feature parameter and the speech recognition algorithm is based on the continuous density hidden Markov model. MCE training is used for the model training to further improve the recognition accuracy. The onchip speech recognition engine employs singlestage recognition architecture, which reduces the complexity of the onchip program and reduces the sensitivity to the speech parameters. Tests show that the MDSR system provides recognition accuracy rates as high as 98.3% and each numeral recognition requires only 35 milliseconds on a 58.5 MIPS DSP.
RESEARCH AND REALISATION OF TANDEM IN MANDARIN SPEECH ERROR DETECTION SYSTEM

Gong Shu,Wei Si,Hu Guoping,Liu Qingfeng

DOI: https://doi.org/10.3969/j.issn.1000-386X.2011.07.071

2011-01-01

Abstract:The HMM/GMM framework which is often used in voice recognition is comparatively poor at mode recognition due to its limitation on training rule and algorithm.Another framework,the HMM/ANN,is better at mode classification but lacks mature and effective optimisation approaches.In the thesis,the authors apply TANDEM which holds the advantages of both frameworks to the mandarin speech error detection system.At the beginning a discriminatingly training neural network estimates rhythm level pro-check probability,then with a series of processes converts the original MFCC feature to TANDEM feature as the input to the HMM statistical model based speech error detection system,consequently completes the evaluation process.Experiment shows the TANDEM approach can greatly improve the error detection performance of the system.It works even better when cooperates with an adaptive approach such as MLLR.
Towards Language-Universal Mandarin-English Speech Recognition

Shiliang Zhang,Yuan Liu,Ming Lei,Bin Ma,Lei Xie

DOI: https://doi.org/10.21437/interspeech.2019-1365

2019-01-01

Abstract:Multilingual and code-switching speech recognition are two challenging tasks that are studied separately in many previous works. In this work, we jointly study multilingual and codeswitching problems, and present a language-universal bilingual system for Mandarin-English speech recognition. Specifically, we propose a novel bilingual acoustic model, which consists of two monolingual system initialized subnets and a shared output layer corresponding to the Character-Subword acoustic modeling units. The bilingual acoustic model is trained using a large Mandarin-English corpus with CTC and sMBR criteria. We find that this model, which is not given any information about language identity, can achieve comparable performance in monolingual Mandarin and English test sets compared to the well-trained language-specific Mandarin and English ASR systems, respectively. More importantly, the proposed bilingual model can automatically learn the language switching. Experimental results on a Mandarin-English code-switching test set show that it can achieve 11.8% and 17.9% relative error reduction on Mandarin and English parts, respectively.
LVCSR System for English and Mandarin Integrated with Language Identification

SUN Jian,WANG Zuo-ying

DOI: https://doi.org/10.3969/j.issn.1000-7024.2007.08.061

2007-01-01

Abstract:In order to transfer the speech into the correspond text without knowing the language,the language identification(LID) is integrated into speech recognition and then the large vocabulary continuous speech recognition(LVCSR) system is developed which support English and mandarin.The language pruning during the LID is discussed for making decision which language the speech belong to early,then the speech can be recognized and the calculation is reduced in decoding.The experiments show that,if the pruning threshold is set reasonable,it could decrease the calculation,and so the system output the recognition result more quickly without losing the performance.
Lightly supervised acoustic model training for mandarin continuous speech recognition

Xiangang Li,Zaihu Pang,Xihong Wu

DOI: https://doi.org/10.1007/978-3-642-36669-7_88

2013-01-01

Abstract:This paper investigates a kind of lightly supervised acoustic model training method for Mandarin continues speech recognition system. The speech materials with rough transcription, which provide some light supervision for acoustic model training, are available in various forms these days. In this work, the quality problem of this kind of data is classified into two types: the first is non-speech and low-quality speech in the corpora, while the second is the transcription errors. A framework is proposed to tackle these two types separately: the speech recognition with transcription-relevant language model is adopted to remove the first type, while with general language model to provide candidate transcription errors which are checked by the final automatic verification process. The performance of proposed framework was evaluated from two aspects: the data quality has significantly improved, and the speech recognition results show that a 21.88% relative CER reduction was obtained.
Research on Modeling Units of Transformer Transducer for Mandarin Speech Recognition

Li Fu,Xiaoxiao Li,Libo Zi

DOI: https://doi.org/10.48550/arXiv.2004.13522

2020-04-26

Abstract:Modeling unit and model architecture are two key factors of Recurrent Neural Network Transducer (RNN-T) in end-to-end speech recognition. To improve the performance of RNN-T for Mandarin speech recognition task, a novel transformer transducer with the combination architecture of self-attention transformer and RNN is proposed. And then the choice of different modeling units for transformer transducer is explored. In addition, we present a new mix-bandwidth training method to obtain a general model that is able to accurately recognize Mandarin speech with different sampling rates simultaneously. All of our experiments are conducted on about 12,000 hours of Mandarin speech with sampling rate in 8kHz and 16kHz. Experimental results show that Mandarin transformer transducer using syllable with tone achieves the best performance. It yields an average of 14.4% and 44.1% relative Word Error Rate (WER) reduction when compared with the models using syllable initial/final with tone and Chinese character, respectively. Also, it outperforms the model based on syllable initial/final with tone with an average of 13.5% relative Character Error Rate (CER) reduction.

Audio and Speech Processing,Computation and Language,Machine Learning,Sound
Duration Model for post-processing in a Mandarin speech recognition system

Yao Li,Jia Liu

2009-01-01

Abstract:The traditional Hidden Markov Model (HMM) has some limitations for Mandarin speech recognition. This paper presents a duration Model for the post-processing stage for Mandarin speech recognition system based on HMM. The best candidate from the decoder is rescored by the normalized duration model with more credible results obtained by comparing the two scores. The syllable error rate is reduced by 10% and the improvement of the insertion error rate is especially significant, which indicates that the method works well for speech recognition and is especially effective for reducing the error rate of insertions.
The Implementation of a Practical Chinese Speech Recognition System For The Parcel Post Checking Task

单翼翔,张昊天,李虎生,钟林,张进,刘加,刘润生

DOI: https://doi.org/10.3321/j.issn:0372-2112.2002.04.025

2002-01-01

Tien Tzu Hsueh Pao/Acta Electronica Sinica

Abstract:In this paper a real-time Parcel Post Checking Speech Recognition System is developed. This system can achieve the parcel post information by means of a medium vocabulary speaker-independent continuous speech technology. Input speech can be Mandarin or Sichuan dialect. Vocabulary size is about 4500. By employing the advantages of the rejection model and speaker adaptation technology, the system robustness is improved remarkably. The experiments show that the system has a very good performance. For mandarin voice input, the recognition accuracy of the top one candidate is 98.7%, and the recognition accuracy of the top three candidates is 99.9%; For Sichuan dialect one the recognition accuracy of the top one candidate is 95.9%, and the recognition accuracy of the top three candidates is 98.6%.
Mandarin Pronunciation Modeling Based on CASS Corpus.

Zheng Fang,Song Zhanjiang,Fung Pascale,William Byrne

DOI: https://doi.org/10.1007/bf02947304

IF: 1.871

2002-01-01

Journal of Computer Science and Technology

Abstract:The pronunciation variability is an important issue that must be faced with when developing practical automatic spontaneous speech recognition systems. In this paper, the factors that may affect the recognition performance are analyzed, including those specific to the Chinese language. By studying the INITIAL/FINAL (IF) characteristics of Chinese language and developing the Bayesian equation, the concepts of generalized INITIAL/FINAL (GIF) and generalized syllable (GS), the GIF modeling and the IF-GIF modeling, as well as the context-dependent pronunciation weighting, are proposed based on a well phonetically transcribed seed database. By using these methods, the Chinese syllable error rate (SER) is reduced by 6.3% and 4.2% compared with the GIF modeling and IF modeling respectively when the language model, such as syllable or word N-gram, is not used. The effectiveness of these methods is also proved when more data without the phonetic transcription are used to refine the acoustic model using the proposed iterative forced-alignment based transcribing (IFABT) method, achieving a 5.7% SER reduction.
Toward On-Line Learning of Chinese Continuous Speech Recognition System.

Rong Zheng,Zuoying Wang

DOI: https://doi.org/10.21437/icslp.1998-748

1998-01-01

Abstract:In this paper, we presented an integrated on-line learning scheme, which combined the state-of-art speaker normalization and adaptation techniques to improve the performance of our large vocabulary Chinese continuous speech recognition (CSR)system. We used VTLN to remove inter-speaker variation in both training and testing stage. To facilitate dynamic transformation scale determination, we devised a tree-based transformation method as the key component of our incrementaladaptation. Experiments shows that the combined scheme of on-line learning (incremental & unsupervised) system, which gives approximately 22~26% error reduction rate, was proved to be better than either method when used separately at and 2.7 . .

Mandarin Continuous Digit Speech Recognition System

High Performance Digit Mandarin Speech Recognition

Design and implementation of a speaker recognition system

Algorithm for Mandarin Continuous Speech Recognition Based on Context-Dependent Unit Between Syllables

An Efficient Computation Algorithm In Mandarin Continuous Speech Recognition

Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Feature Selection In Mandarin Large Vocabulary Continuous Speech Recognition

An Improved Linear Discriminant Analysis for Mandarin Digit Speech Recognition

A System for Mandarin Short Phrase Recognition on Portable Devices

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

High Performance Mandarin Digit Recognition System on a DSP Chip

RESEARCH AND REALISATION OF TANDEM IN MANDARIN SPEECH ERROR DETECTION SYSTEM

Towards Language-Universal Mandarin-English Speech Recognition

LVCSR System for English and Mandarin Integrated with Language Identification

Lightly supervised acoustic model training for mandarin continuous speech recognition

Research on Modeling Units of Transformer Transducer for Mandarin Speech Recognition

Duration Model for post-processing in a Mandarin speech recognition system

The Implementation of a Practical Chinese Speech Recognition System For The Parcel Post Checking Task

Mandarin Pronunciation Modeling Based on CASS Corpus.

Toward On-Line Learning of Chinese Continuous Speech Recognition System.