Neural network language model training method and device and voice recognition method

Liu Jia,Shi Yongzhe,Zhang Weiqiang,He Liang,Wang Lishao,Wang Yanqiang
2015-01-01
Abstract:The invention discloses a neural network language model training method and device and a voice recognition method and relates to the voice recognition technology. The neural network language model training method and device and the voice recognition method aim to solve the problem that in the prior art, when the computation complexity of a neural network language model is lowered, the recognition accuracy of the neural network language model is lowered. According to the technical scheme, in the process of training parameters of the neural network language model, normalization factors of an output layer are adopted to modify a target cost function, and a modified target cost function is obtained; the parameters of the neural network language model are updated according to the modified target cost function to obtain trained target parameters of the neural network language model, wherein the target parameters enable the normalization factors in the trained neural network language model to be constants. The neural network language model training method and device and the voice recognition method can be applied to the neural network voice recognition process.
What problem does this paper attempt to address?