Research on Sentence Semantic Similarity Calculation Based on Word2vec
LI Xiao,XIE Hui,LI Li-jie
DOI: https://doi.org/10.11896/j.issn.1002-137x.2017.09.048
2017-01-01
Abstract:Using the idea of deep learning,word2vec can automatically learn the essential information of data from largescale text data.Therefore,with the help of LTP platform of Harbin Institute of Technology,based on the word2vec model,the processing of the sentence is simplified as a vector in the vector space algorithm,and the similarity of vector space represents the sentence semantic similarity.In addition,the sentence structure information is added to the sentence similarity calculation,the algorithm are improved on the special sentence pattern,and the syntax relationship between words is taken into account.The experimental results show that this method is more accurately to reveal the semantic relations between sentences,syntactic structure and improved extraction algorithm also solve the problem of computing the similarity of complex sentences,finally improve the accuracy of the similarity calculation.