Abstract:Speech recognition has always been one of the research focuses in the field of human-computer communication and interaction. The main purpose of automatic speech recognition (ASR) is to convert speech waveform signals into text. Acoustic model is the main component of ASR, which is used to connect the observation features of speech signals with the speech modeling units. In recent years, deep learning has become the mainstream technology in the field of speech recognition. In this paper, a convolutional neural network architecture composed of VGG and Connectionist Temporal Classification (CTC) loss function was proposed for speech recognition acoustic model. Traditional acoustic model training is based on frame-level labels with cross-entropy criterion, which requires a tedious label alignment procedure. The CTC loss was adopted to automatically learn the alignments between speech frames and label sequences, such that the training process is end-to-end. The architecture can exploit temporal and spectral structures of speech signals simultaneously. Batch normalization (BN) technique was used for normalizing each layers input to reduce internal covariance shift. To prevent overfitting, dropout technique was used during training to improve network generalization ability. The speech signal was transformed into a spectral image through a series of processing to be the input of the neural network. The input feature is 200 dimensions, and output labels of acoustic mode is 415 Chinese pronunciation without pitch. The experimental results demonstrated that the proposed model achieves the Character error rate (CER) of 17.97% and 23.86% on public Mandarin speech corpus, AISHELL-1 and ST-CMDS-20170001_1, respectively.

Recent Progresses in Deep Learning based Acoustic Models (Updated)

Toward a Better Understanding of Deep Neural Network Based Acoustic Modelling: An Empirical Investigation

Deep Recurrent Neural Networks for Acoustic Modelling

An Acoustic Model for English Speech Recognition Based on Deep Learning

Maxout Neurons Based Deep Bidirectional Lstm For Acoustic Modeling

Multidimensional Residual Learning Based On Recurrent Neural Networks For Acoustic Modeling

Deep Learning for Acoustic Modeling in Parametric Speech Generation: A systematic review of existing techniques and future trends

Acoustic Modeling Based on Deep Learning for Low-Resource Speech Recognition: An Overview

A Chinese Acoustic Model Based On Convolutional Neural Network

Distributed Training of Deep Neural Network Acoustic Models for Automatic Speech Recognition: A comparison of current training strategies

Recent Advances in End-to-End Automatic Speech Recognition

Building DNN acoustic models for large vocabulary speech recognition

Improving Robustness of Deep Neural Network Acoustic Models via Speech Separation and Joint Adaptive Training

Analyzing deep CNN-based utterance embeddings for acoustic model adaptation

A Survey of Deep Learning Techniques in Speech Recognition

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

Joint Acoustic Factor Learning for Robust Deep Neural Network Based Automatic Speech Recognition

Speaker-aware Training of LSTM-RNNS for Acoustic Modelling

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition.