Abstract:In spite of the great success of the deep neural network (DNN) in speech processing, it is still unclear what kind of underlying mechanisms are involved in this achievement. This preliminary study attempts to find an answer by investigating the functions of DNN's hidden layers in representing speech articulations. Two sets of experiments are performed on the hidden layers in speech recognition. The layer removing experiment is conducted on the English TIMIT database, and the layer replacing experiment is to substitute a layer in an English DNN by the corresponding layer in a Japanese DNN. It is found that the different layers seem to be responsible for different phoneme groups according to the place of articulation. The lower layers are responsible for the back vowels, and the higher layers are responsible for the front vowels. The second layer (i.e. the first hidden layer) of the seven-layer network has major responsibility for more than half of the consonants with the constriction located in the front of the vocal tract, while the other consonants rely on the middle and higher layers. The layer replacing experiment demonstrated that the above relation was language independent. It is necessary to design elaborate studies to discover more details in the future.

The Research of Acoustic Layer Recognition Based on Pinyin Model

Acoustic Modeling Based On Chinese Phonetics Knowledge

Research on acoustic Model of Putian Dialect Speech Recognition Based on Deep Learning

A New Acoustic Modeling of Inter-Syllable Context-Dependent Units for Putonghua Continuous Speech Recognition

Phonotactic language recognition based on DNN-HMM acoustic model

Research on deep neural network's hidden layers in phoneme recognition

An Acoustic Model for English Speech Recognition Based on Deep Learning

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Boosting Character-based Mandarin ASR via Chinese Pinyin Representation

Initial/final acoustic model based on separating nasal coda in Chinese Putonghua speech recognition

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

English Alphabet Recognition Based on Chinese Acoustic Modeling

Research on the nasal parameters of speaker recognition system

An Mandarin Pronunciation Quality Assessment System Using Two Kinds of Acoustic Models

Bridging Speech and Text: Enhancing ASR with Pinyin-to-Character Pre-training in LLMs

Phonetic Temporal Neural Model for Language Identification

STUDY ON FRAMEWORK FOR CHINESE PRONUNCIATION VARIATION MODELING

A pronunciation quality evaluation method based on the phoneme model perception

Phonetic Classification-Based Triphone for Continuous Mandarin Speech Recognition

High-resolution Acoustic Modeling and Compact Language Modeling of Language-Universal Speech Attributes for Spoken Language Identification.