Abstract:Neural networks have received considerable attention in sentence similarity measuring systems due to their efficiency in dealing with semantic composition. However, existing neural network methods are not sufficiently effective in capturing the most significant semantic information buried in an input. To address this problem, a novel weighted-pooling attention layer is proposed to retain the most remarkable attention vector. It has already been established that long short-term memory and a convolution neural network have a strong ability to accumulate enriched patterns of whole sentence semantic representation. First, a sentence representation is generated by employing a siamese structure based on bidirectional long short-term memory and a convolutional neural network. Subsequently, a weighted-pooling attention layer is applied to obtain an attention vector. Finally, the attention vector pair information is leveraged to calculate the score of sentence similarity. An amalgamation of both, bidirectional long short-term memory and a convolutional neural network has resulted in a model that enhances information extracting and learning capacity. Investigations show that the proposed method outperforms the state-of-the-art approaches to datasets for two tasks, namely semantic relatedness and Microsoft research paraphrase identification. The new model improves the learning capability and also boosts the similarity accuracy as well.

Sentence Similarity Computation by Integrating Shallow and Deep Information

A Joint Model for Sentence Semantic Similarity Learning

Convolutional Network-Based Semantic Similarity Model of Sentences

Sentence Similarity Computational Model Based on Information Content.

Chinese Sentence Similarity Based on Multi-feature Combination

A Model for Chinese Sentence Similarity Computing

Chinese Sentence Similarity Computational Model Based on Multi-Features Combination

Sentence Similarity Measurement Based on Shallow Parsing

Semantic Similarity Computing Model Based on Multi Model Fine-Grained Nonlinear Fusion

Sentence-Embedding and Similarity via Hybrid Bidirectional-LSTM and CNN Utilizing Weighted-Pooling Attention

A Chinese Short Text Similarity Method Integrating Sentence-Level and Phrase-Level Semantics

Improved Chinese Sentence Semantic Similarity Calculation Method Based on Multi-Feature Fusion

Sentence Similarity Computation Based on Feature Set

Ercnn: Enhanced Recurrent Convolutional Neural Networks For Learning Sentence Similarity

CHINESE SENTENCE SIMILARITY COMPUTING BASED ON IMPROVED EDIT-DISTANCE AND DEPENDENCY GRAMMAR

Fusing Syntax and Word Embedding Knowledge for Measuring Semantic Similarity

A Novel Sentence Similarity Model with Word Embedding Based on Convolutional Neural Network.

An Improved Method of Computing Chinese Sentence Similarity

Chinese Sentence Similarity Computing Based on Semantic Dependency Relationship Analysis

Multi-Granularity Neural Sentence Model For Measuring Short Text Similarity

Chinese long text similarity calculation of semantic progressive fusion based on Bert