Abstract:In this paper, we present an improved feedforward sequential memory networks (FSMN) architecture, namely Deep-FSMN (DFSMN), by introducing skip connections between memory blocks in adjacent layers. These skip connections enable the information flow across different layers and thus alleviate the gradient vanishing problem when building very deep structure. As a result, DFSMN significantly benefits from these skip connections and deep structure. We have compared the performance of DFSMN to BLSTM both with and without lower frame rate (LFR) on several large speech recognition tasks, including English and Mandarin. Experimental results shown that DFSMN can consistently outperform BLSTM with dramatic gain, especially trained with LFR using CD-Phone as modeling units. In the 20000 hours Fisher (FSH) task, the proposed DFSMN can achieve a word error rate of 9.4% by purely using the cross-entropy criterion and decoding with a 3-gram language model, which achieves a 1.5% absolute improvement compared to the BLSTM. In a 20000 hours Mandarin recognition task, the LFR trained DFSMN can achieve more than 20% relative improvement compared to the LFR trained BLSTM. Moreover, we can easily design the lookahead filter order of the memory blocks in DFSMN to control the latency for real-time applications.

A two-layer lexical tree based beam search in continuous Chinese speech recognition

Cross-word Search Algorithm Based on Two-Layer Lexical Tree for Speech Recognition

Research on continuous Chinese speech recognition system and knowledge based search strategies

An Efficient Layer-Wised Beam Pruning Algorithm for Large Vocabulary Continuous Speech Recognition System

Improving the Syllable-Synchronous Network Search Algorithm for Word Decoding in Continuous Chinese Speech Recognition

Efficient graph search algorithm for embedded speech recognition

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

ON CHINESE CONTINUOUS SPEECH RECOGNITION SYSTEM AND KNOWLEDGE BASED SEARCH STRATEGIES SONG Zhanjiang

A Novel Beam Search Algorithm Of Speech Recognition For Voice Command Control

Research on Inter-Syllable Context-Dependent Acoustic Unit for Mandarin Continuous Speech Recognition.

Improved context-dependent acoustic modeling for continuous Chinese speech recognition

Context Dependent Initial/final Acoustic Modeling for Continuous Chinese Speech Recognition

Efficient Embedded Speech Recognition for Very Large Vocabulary Mandarin Car-Navigation Systems

Continuous Speech Recognition Based on the Triphone DDBHMM

Algorithm for Mandarin Continuous Speech Recognition Based on Context-Dependent Unit Between Syllables

Reducing time-synchronous beam search effort using stage based look-ahead and language model rank based pruning

Two-level Search Strategy Based on Reverse HMM and Its Applications

Improved algorithm with duration information for continuous speech recognition

Deep-FSMN for Large Vocabulary Continuous Speech Recognition

Easytalk: a large-vocabulary speaker-independent Chinese dictation machine

Research on Optimal Algorithm of Likelihood Computation in Continuous Speech Recognition