Abstract:Speech is one of the ways of human-computer interaction, and speech recognition technology is an important part of artificial intelligence. In recent years, the application of neural network technology in the field of speech recognition has developed rapidly, and it has become the mainstream acoustic modeling technology in the field of speech recognition. However, there is a difference between target speaker's voice and training data in the test conditions, which leads to the problem of model incompatibility. Therefore, the speaker adaptation (SA) method is to solve the mismatch problem caused by the speaker difference, and the research on the speaker adaptation method has become a popular direction in the field of speech recognition. Compared with the speaker adaptation method in the traditional speech recognition system, the self-adaptation in the speech recognition system using neural network has the characteristics of huge model parameters and relatively small amount of data. Therefore, the speaker adaptation method in the neural network-based speech recognition system becomes a challenge. Firstly, this paper reviews the development history of the speaker adaptation method and the various problems encountered in the research of the neural network-based speaker adaptation method. Secondly, the speaker adaptation method is divided into the speaker adaptation method based on feature domain and the speaker adaptation method based on model domain. It also introduces the corresponding principles and improvement methods, and finally points out the pro-blems that still exist in the speaker adaptation method in speech recognition and the future development direction.

A Comparison of Expressive Speech Synthesis Approaches based on Neural Network

Emotional Statistical Parametric Speech Synthesis Using LSTM-RNNs

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Linear Networks Based Speaker Adaptation for Speech Synthesis

Investigating Deep Neural Network Adaptation for Generating Exclamatory and Interrogative Speech in Mandarin

Expressive Speech Driven Talking Avatar Synthesis with DBLSTM Using Limited Amount of Emotional Bimodal Data

Generalisation and Robustness Investigation for Facial and Speech Emotion Recognition Using Bio-Inspired Spiking Neural Networks

Model architectures to extrapolate emotional expressions in DNN-based text-to-speech

Survey of Speaker Adaptation Methods in Speech Recognition

A New Network Structure for Speech Emotion Recognition Research

Research on Chinese Speech Emotion Recognition Based on Deep Neural Network and Acoustic Features

Emphatic Speech Generation with Conditioned Input Layer and Bidirectional LSTMS for Expressive Speech Synthesis.

Feature Based Adaptation for Speaking Style Synthesis

An Experimental Study on Speech Enhancement Based on Deep Neural Networks

Describing and Predicting Affective Messages for Expressive Speech Synthesis

Transfer Learning Based Progressive Neural Networks for Acoustic Modeling in Statistical Parametric Speech Synthesis.

Speaker-Independent Speech-Driven Visual Speech Synthesis using Domain-Adapted Acoustic Models

A Unified Speaker Adaptation Method for Speech Synthesis using Transcribed and Untranscribed Speech with Backpropagation

Speech-driven Head Motion Synthesis Using Neural Networks

StrengthNet: Deep Learning-based Emotion Strength Assessment for Emotional Speech Synthesis

Improve Emotional Speech Synthesis Quality by Learning Explicit and Implicit Representations with Semi-Supervised Training