Abstract:This paper presents our developed decoder which adopts the idea of statically optimizing part of the knowledge sources while handling the others dynamically. The lexicon, phonetic contexts and acoustic model are statically integrated to form a memory-efficient state network, while the language model (LM) is dynamically incorporated on the fly by means of extended tokens. The novelties of our approach for constructing the state network are (1) introducing two layers of dummy nodes to cluster the cross-word (CW) context dependent fan-in and fan-out triphones, (2) introducing a so-called “WI layer” to store the word identities and putting the nodes of this layer in the non-shared mid-part of the network, (3) optimizing the network at state level by a sufficient forward and backward node-merge process. The state network is organized as a multi-layer structure for distinct token propagation at each layer. By exploiting the characteristics of the state network, several techniques including LM look-ahead, LM cache and beam pruning are specially designed for search efficiency. Especially in beam pruning, a layer-dependent pruning method is proposed to further reduce the search space. The layer-dependent pruning takes account of the neck-like characteristics of WI layer and the reduced variety of word endings, which enables tighter beam without introducing much search errors. In addition, other techniques including LM compression, lattice-based bookkeeping and lattice garbage collection are also employed to reduce the memory requirements. Experiments are carried out on a Mandarin spontaneous speech recognition task where the decoder involves a trigram LM and CW triphone models. A comparison with HDecode of HTK toolkits shows that, within 1% performance deviation, our decoder can run 5 times faster with half of the memory footprint.

An Efficient Layer-Wised Beam Pruning Algorithm for Large Vocabulary Continuous Speech Recognition System

Reducing time-synchronous beam search effort using stage based look-ahead and language model rank based pruning

Beam Pruning Based on Quantile for Keyword Spotting

A study of modifying pruning strategies for dp beam search at a preset input frame

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

A two-layer lexical tree based beam search in continuous Chinese speech recognition

Task-Agnostic Structured Pruning of Speech Representation Models

A Novel Beam Search Algorithm Of Speech Recognition For Voice Command Control

SparseWAV: Fast and Accurate One-Shot Unstructured Pruning for Large Speech Foundation Models

Efficient Beam Thresholding for Statistical Machine Translation.

Improved algorithm with duration information for continuous speech recognition

Construction of a compact dynamic decoder network for large vocabulary continuous speech recognition

A Novel Approach to Structured Pruning of Neural Network for Designing Compact Audio-Visual Wake Word Spotting System

Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognition

Streamlining Speech Enhancement DNNs: an Automated Pruning Method Based on Dependency Graph with Advanced Regularized Loss Strategies

Deep LSTM for Large Vocabulary Continuous Speech Recognition

A One-Pass Real-Time Decoder Using Memory-Efficient State Network

Efficient Embedded Speech Recognition for Very Large Vocabulary Mandarin Car-Navigation Systems

Efficient graph search algorithm for embedded speech recognition

Structured Pruning of Self-Supervised Pre-trained Models for Speech Recognition and Understanding

Dynamic Data Pruning for Automatic Speech Recognition