Abstract:Speech recognition has always been one of the research focuses in the field of human-computer communication and interaction. The main purpose of automatic speech recognition (ASR) is to convert speech waveform signals into text. Acoustic model is the main component of ASR, which is used to connect the observation features of speech signals with the speech modeling units. In recent years, deep learning has become the mainstream technology in the field of speech recognition. In this paper, a convolutional neural network architecture composed of VGG and Connectionist Temporal Classification (CTC) loss function was proposed for speech recognition acoustic model. Traditional acoustic model training is based on frame-level labels with cross-entropy criterion, which requires a tedious label alignment procedure. The CTC loss was adopted to automatically learn the alignments between speech frames and label sequences, such that the training process is end-to-end. The architecture can exploit temporal and spectral structures of speech signals simultaneously. Batch normalization (BN) technique was used for normalizing each layers input to reduce internal covariance shift. To prevent overfitting, dropout technique was used during training to improve network generalization ability. The speech signal was transformed into a spectral image through a series of processing to be the input of the neural network. The input feature is 200 dimensions, and output labels of acoustic mode is 415 Chinese pronunciation without pitch. The experimental results demonstrated that the proposed model achieves the Character error rate (CER) of 17.97% and 23.86% on public Mandarin speech corpus, AISHELL-1 and ST-CMDS-20170001_1, respectively.

A Chinese Speech Recognition System Based on Articulatory Features

Applying Articulatory Features to Speech Emotion Recognition

Application of Articulatory Feature in Uygur and Mandar in Speech Recognition

Comparison of Two Cross-lingual AF Extraction Methods

Cross-lingual Automatic Speech Recognition Exploiting Articulatory Features

Detection-based accented speech recognition using articulatory features.

Robust Speech Recognition Combining Cepstral and Articulatory Features

Accent Recognition with Hybrid Phonetic Features

Articulatory Feature-based Acoustic Modeling for Uighur Speech Recogniton

Multilingual Articulatory Features Augmentation Learning

Utilizing auxiliary data in phoneme recognition based on Articulatory Feature

Robust Audio-Visual Mandarin Speech Recognition Based on Adaptive Decision Fusion and Tone Features

A Chinese speech recognition system

Connected Mandarin Digit Speech Recognition Using Two-Layer Acoustic Universal Structure

AHMM Based Speech Synthesis Method Using Articulatory Feature

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Robust Recognition of Mandarin Vowels by Articulatory Manners

A Chinese Acoustic Model Based On Convolutional Neural Network

Exploring Pre-trained Speech Model for Articulatory Feature Extraction in Dysarthric Speech Using ASR

Exploiting Cross-domain And Cross-Lingual Ultrasound Tongue Imaging Features For Elderly And Dysarthric Speech Recognition

Decoupling recognition and transcription in Mandarin ASR