Abstract:End-to-end models have been widely used in Automatic Speech Recognition (ASR). Convolutional Neural Networks (CNNs) can effectively use spectrum information to model acoustic models. However, the convolution layers have limitations on the receptive field leading to restrictions for long speech signals. Inspired by this, we propose a Cube Attention CNN network(CACnet) that uses two different attention blocks to integrate the feature information of different dimensions for extending context information. Thereinto, the Global Deep Attention Block utilizes non-local operations to compute interactions between any two positions on feature maps and enables the acquirement of global feature representations while the Cross-Channel Attention Block adaptively recalibrates channel-wise feature responses. Then, outputs of the above two attention modules will be added up to further improve the feature representation which contributes to enrich contextual information. Finally, the performance of our proposed architecture will be explored under ASR tasks in English circumstances. Experiments on LibriSpeech indicate that CACnet achieves a word error rate (WER) of 3.78%/9.56% without language model (LM), and 2.84%/6.97% with LM, which is near state-of-the-art accuracy. CACnet on WSJ with 4.4% WER obtains better performance, compared to CTC-based CNN models, such as QuartzNet and Jasper, with the same language model. The proposed network achieves competitive accuracy while having fewer parameters. Moreover, CACnet can be easily incorporated into any existed network since it has the same input and output dimensions.

Attention-Based Gated Scaling Adaptive Acoustic Model for CTC-Based Speech Recognition.

Adaptive Speaker Normalization for CTC-Based Speech Recognition

CR-CTC: Consistency regularization on CTC for improved speech recognition

CTC Regularized Model Adaptation for Improving LSTM RNN Based Multi-Accent Mandarin Speech Recognition

Unsupervised Regularization-Based Adaptive Training for Speech Recognition

Acoustic Modeling With Dfsmn-Ctc And Joint Ctc-Ce Learning

Advancing Acoustic-to-Word CTC Model

Improving CTC-AED model with integrated-CTC and auxiliary loss regularization

Attention-Based Deep Spiking Neural Networks for Temporal Credit Assignment Problems.

End-to-End Speech Recognition Model Based on Dilated Sparse Aware Network

Residual Convolutional CTC Networks for Automatic Speech Recognition.

CRF-based Single-stage Acoustic Modeling with CTC Topology.

An improved hybrid CTC-Attention model for speech recognition

Multi-Scale Temporal Frequency Convolutional Network With Axial Attention for Speech Enhancement

Enhancing CTC-based speech recognition with diverse modeling units

AdaMER-CTC: Connectionist Temporal Classification with Adaptive Maximum Entropy Regularization for Automatic Speech Recognition

CACnet: Cube Attentional CNN for Automatic Speech Recognition

Improving Hybrid CTC/Attention Architecture for Agglutinative Language Speech Recognition

CAT: CRF-based ASR Toolkit

Hierarchical Cross-Modality Knowledge Transfer with Sinkhorn Attention for CTC-based ASR

Speaker Adaptation for End-to-End CTC Models.