Abstract:To overcome some weaknesses of hidden Markov model in speech recognition, HMM/NN hybrid systems had been explored by many researchers in recent years. In the previous HMM/NN hybrid systems, the neural networks adopted are mostly multilayer perceptron (MLP). In our system, recurrent neural networks (RNN) were used to take the place of MLP as the syllable probability estimator. RNN is MLP incorporated with a feedback which can transport the output of some neurons to other neurons or themselves. The incorporation of feedback into a MLP gives the net the ability to efficiently process the context information of time sequence, which is especially useful for speech recognition. In this paper, the architecture of the RNN is modified and corresponding training schema is presented. 　　Following techniques have been adopted in our system. 　　1. A network with a single layer has been adopted, while the content of feedback is different from the network used by previous researchers, i.e., the external output is included in the feedback, not just the internal state output. 　　2. The training algorithm adopted in our system is back-propagation through time (BPTT) algorithm. In the common BPTT algorithm, the initial feedback values are set arbitrarily according to experience. This means that the initial feedback is not specific to the problem we are dealing with. So it should be preferable if the initial feedback values also can be trained. In our training algorithm, this is achieved by adding an additional layer to the unfolded network. 　　3. To train the network, proper target values must be given. To acquire them, we take use of HMMs which have been trained to recognize the same syllables. The advantage of this method is that it avoids the difficulty and inaccuracy of the hand-set teacher signals and it gives a smooth transition between two adjacent states. 　　4. In order to make the network learn faster and acquire better generalization ability, a strategy which trains the network by stages has been used. At first, short fragments of speech sequences are given. After small enough error has been achieved on these short pieces, longer fragments are used to learn. Finally, whole sequences are learned. 　　Experiment results show that the training speed can be accelerated by the method, and the recognition performance is also improved.

Multiplayer Recurrent Fuzzy Neural Network Modeling Based on Hybrid Chaotic Search Method

Batch-To-Batch Control of Batch Processes Based on Multilayer Recurrent Fuzzy Neural Network

A neurofuzzy network structure for nonlinear system modeling

Cuckoo Search Algorithm with Membrane Communication Mechanism for Modeling Overhead Crane Systems Using RBF Neural Networks.

A nonlinear predictive control algorithm based on fuzzy online modeling and discrete optimization

Fuzzy Recurrent Neural Network Modeling Based on Chaos DNA Genetic Algorithm

Fuzzy Neural Network Based on Hybrid Learning Algorithm and Its Application to Soft Sensor

Nonlinear adaptive control based on RBF networks and multi-model method

Study on Learning Algorithm of a Kind of Multi-Neural Networks Hybrid Model

Research on the Method of Neural Network Modeling Based on FCM Algorithm and Its Application on Vision-based Sensors

A Hybrid Modeling Method Based on Mechanism Analysis,Identification and Rbf Neural Networks

Multi-grain Cascade Recurrent Neural Network for Nonlinear Time-varying Process Soft Sensor Modeling

Neuro-fuzzy System Modeling Based on Automatic Fuzzy Clustering

Identification and control of dynamic systems using recurrent fuzzy neural networks

Fuzzy $H_{\infty }$ Control of Discrete-Time Nonlinear Markov Jump Systems via a Novel Hybrid Reinforcement $Q$-Learning Method

Automatic Structure and Parameter Training Methods for Modeling of Mechanical System by Recurrent Neural Networks

Fuzzy Multiple Hidden Layer Recurrent Neural Control of Nonlinear System Using Terminal Sliding-Mode Controller

A Self-Organizing Neural-Network-based Fuzzy System

Speech Recognition Model Based on Recurrent Neural Networks

Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems

Recurrent Interval Type-2 Fuzzy Wavelet Neural Network with Stable Learning Algorithm: Application to Model-Based Predictive Control