Sentence Similarity Measurement Based on Shallow Parsing

Lin Li,Yiming Zhou,Boqiu Yuan,Jun Wang,Xia Hu
DOI: https://doi.org/10.1109/fskd.2009.657
2009-01-01
Abstract:The paper proposes a novel method to determine sentence similarities. First two compared sentences are parsed by shallow-parsing and all noun phrases, verb phrases and preposition phrases of each sentence are extracted. Then the similarity between each kind of phrases is calculated based on a semantic vector method. The overall sentence similarity is defined as a combination of semantic similarities of the three kinds of phrases. Experiments show that the proposed method has a high performance in F-measure (81.6%) and Recall (97.4%).
What problem does this paper attempt to address?