Abstract:A deep learning approach has been widely applied in sequence modeling problems. In terms of automatic speech recognition (ASR), its performance has significantly been improved by increasing large speech corpus and deeper neural network. Especially, recurrent neural network and deep convolutional neural network have been applied in ASR successfully. Given the arising problem of training speed, we build a novel deep recurrent convolutional network for acoustic modeling and then apply deep residual learning to it. Our experiments show that it has not only faster convergence speed but better recognition accuracy over traditional deep convolutional recurrent network. In the experiments, we compare the convergence speed of our novel deep recurrent convolutional networks and traditional deep convolutional recurrent networks. With faster convergence speed, our novel deep recurrent convolutional networks can reach the comparable performance. We further show that applying deep residual learning can boost the convergence speed of our novel deep recurret convolutional networks. Finally, we evaluate all our experimental networks by phoneme error rate (PER) with our proposed bidirectional statistical n-gram language model. Our evaluation results show that our newly proposed deep recurrent convolutional network applied with deep residual learning can reach the best PER of 17.33\% with the fastest convergence speed on TIMIT database. The outstanding performance of our novel deep recurrent convolutional neural network with deep residual learning indicates that it can be potentially adopted in other sequential problems.

Structure Growth for Small-Footprint Speech Recognition

Extremely Low Footprint End-to-End ASR System for Smart Device

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Dynamic Encoder Size Based on Data-Driven Layer-wise Pruning for Speech Recognition

Optimizing Speech Recognition For The Edge

Building DNN acoustic models for large vocabulary speech recognition

Efficient Gradient-Based Neural Architecture Search for End-to-End ASR

Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition

Efficient Binary Weight Convolutional Network Accelerator for Speech Recognition

TODM: Train Once Deploy Many Efficient Supernet-Based RNN-T Compression For On-device ASR Models

Learned Transferable Architectures Can Surpass Hand-Designed Architectures for Large Scale Speech Recognition

Improving deep neural networks for LVCSR using dropout and shrinking structure

Improved Conformer-based End-to-End Speech Recognition Using Neural Architecture Search

Conformer-Based Speech Recognition On Extreme Edge-Computing Devices

Deep Recurrent Convolutional Neural Network: Improving Performance For Speech Recognition

Efficient Neural Architecture Search for End-to-end Speech Recognition via Straight-Through Gradients

A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Models

Sharing Low Rank Conformer Weights for Tiny Always-On Ambient Speech Recognition Models

Investigating Online Low-Footprint Speaker Adaptation Using Generalized Linear Regression and Click-Through Data.

Darts-Conformer: Towards Efficient Gradient-Based Neural Architecture Search for End-to-End ASR