Abstract:Speech recognition technology has played an indispensable role in realizing human-computer intelligent interaction. However, most of the current Chinese speech recognition systems are provided online or offline models with low accuracy and poor performance. To improve the performance of offline Chinese speech recognition, we propose a hybrid acoustic model of deep convolutional neural network, long short-term memory, and deep neural network (DCNN-LSTM-DNN, DLD). This model utilizes DCNN to reduce frequency variation and adds a batch normalization (BN) layer after its convolutional layer to ensure the stability of data distribution, and then use LSTM to effectively solve the gradient vanishing problem. Finally, the fully connected structure of DNN is utilized to efficiently map the input features into a separable space, which is helpful for data classification. Therefore, leveraging the strengths of DCNN, LSTM, and DNN by combining them into a unified architecture can effectively improve speech recognition performance. Our model was tested on the open Chinese speech database THCHS-30 released by the Center for Speech and Language Technology (CSLT) of Tsinghua University, and it was concluded that the DLD model with 3 layers of LSTM and 3 layers of DNN had the best performance, reaching 13.49% of words error rate (WER).

Research on Optimal Algorithm of Likelihood Computation in Continuous Speech Recognition

Research on optimal algorithm of likelihood computation in continuous speech recognition

An Efficient Computation Algorithm In Mandarin Continuous Speech Recognition

Research on Speaker-Depended Isolated-Word Speech Recognition System

FAST LIKELIHOOD COMPUTATION METHOD USING BLOCK-DIAGONAL COVARIANCE MATRICES IN HIDDEN MARKOV MODEL

Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

Maximum Probability Increase Estimation Method for Fast Gaussian Likelihood Computations

Algorithm for Mandarin Continuous Speech Recognition Based on Context-Dependent Unit Between Syllables

A Novel Information Integration Algorithm for Speech Recognition System: Basing on Adaptive Clustering and Supervised State of Acoustic Feature

Simulation of English Speech Recognition Based on Improved Extreme Random Forest Classification

A Fast Error-tolerant Algorithm in Decoding Module of Speech Recognition

Novel Efficient Algorithms in Speech / Speaker Recognition

Research on continuous Chinese speech recognition system and knowledge based search strategies

Real-Time Speech Recognition Method for Embedded System

Linguistic Search Optimization for Deep Learning Based LVCSR

A two-layer lexical tree based beam search in continuous Chinese speech recognition

DLD: An Optimized Chinese Speech Recognition Model Based on Deep Learning

Adaptive Compensation Algorithm in Open Vocabulary Mandarin Speaker-Independent Speech Recognition

A Mandarin Speech Recognition Result Evaluation Algorithm on Mixed Words

An Algorithm of Model Compensation Based on the Estimation of Additive Noise and Channel Function for Speech Recognition