Abstract:In automatic speech recognition (ASR) research, discriminative criteria have achieved superior performance in DNN-HMM systems. Given this success, the adoption of discriminative criteria is promising to boost the performance of end-to-end (E2E) ASR systems. With this motivation, previous works have introduced the minimum Bayesian risk (MBR, one of the discriminative criteria) into E2E ASR systems. However, the effectiveness and efficiency of the MBR-based methods are compromised: the MBR criterion is only used in system training, which creates a mismatch between training and decoding; the on-the-fly decoding process in MBR-based methods results in the need for pre-trained models and slow training speeds. To this end, novel algorithms are proposed in this work to integrate another widely used discriminative criterion, lattice-free maximum mutual information (LF-MMI), into E2E ASR systems not only in the training stage but also in the decoding process. The proposed LF-MMI training and decoding methods show their effectiveness on two widely used E2E frameworks: Attention-Based Encoder-Decoders (AEDs) and Neural Transducers (NTs). Compared with MBR-based methods, the proposed LF-MMI method: maintains the consistency between training and decoding; eschews the on-the-fly decoding process; trains from randomly initialized models with superior training efficiency. Experiments suggest that the LF-MMI method outperforms its MBR counterparts and consistently leads to statistically significant performance improvements on various frameworks and datasets from 30 hours to 14.3k hours. The proposed method achieves state-of-the-art (SOTA) results on Aishell-1 (CER 4.10%) and Aishell-2 (CER 5.02%) datasets. Code is released.

Discriminative environment feature extraction for robust speech recognition

Robust Speech Recognition Method Based on Discriminative Environment Feature Extraction

Robust Speech Recognition Method Based on Discriminative Learning of Environmental Features

HMM training method based on evolutionary computation and MDI in speech recognition

Simplified Deformation Compensation for Emotional Speaker Recognition

Toward emotional speaker recognition: framework and preliminary results

Noisy speech recognition performance of discriminative HMMs

Performance of Discriminative HMM Training in Noise.

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Compensation of Speech Enhancement Distortion for Robust Speech Recognition

Speech Emotion Recognition Based on Feature Selection and Extreme Learning Machine Decision Tree

Discriminative Speaker Adaptation with Eigenvoices

Time–Frequency Cepstral Features and Heteroscedastic Linear Discriminant Analysis for Language Recognition

Discriminative Dynamic Gaussian Mixture Selection with Enhanced Robustness and Performance for Multi-Accent Speech Recognition

Mismatched Feature Detection with Finer Granularity for Emotional Speaker Recognition.

Factorised Speaker-environment Adaptive Training of Conformer Speech Recognition Systems

Robust Front-End for Speech Recognition Based on Computational Auditory Scene Analysis and Speaker Model

On the Importance of Components of the MFCC in Speech and Speaker Recognition.

Combining Speech Enhancement and Discriminative Feature Extraction for Robust Speaker Recognition

Using MCE Algorithm to Improve the Performance of Speaker Recognition

Integrating Lattice-Free MMI into End-to-End Speech Recognition