Method and system for constructing language model, input method and input method system

Yu Kai,Qian Yanmin,Liu Qi
2018-01-01
Abstract:The invention discloses a method for constructing a language model. The method comprises the following steps that: obtaining the future vector of a sentence in text data, wherein the future vector ofthe sentence is a vector extracted after the sentence is reverse; taking a preamble in the sentence in the text data as a first input, taking the future vector of the sentence as a first output, and training to obtain a future vector prediction network; at least taking an output value which is input into the future vector prediction network by the preamble in the sentence as a second input, and taking the subsequent word of the preamble of the sentence as a second output, and training to obtain a main neural network; and on the basis of the future vector prediction network and the main neuralnetwork, generating the language model. By use of the method, through a way that the known preamble and the future vector of the known preamble are comprehensively considered, the language model is constructed, so that the constructed language model can be combined with current preamble information from a whole sentence layer (future vector) to predict the subsequent word, and the accuracy and thereliability of prediction are improved.
What problem does this paper attempt to address?