Abstract:Cross-language sentence similarity computation is among the focuses of research in natural language processing (NLP). At present, some researchers have introduced fine-grained word and character features to help models understand sentence meanings, but they do not consider coarse-grained prior knowledge at the sentence level. Even if two cross-linguistic sentence pairs have the same meaning, the sentence representations extracted by the baseline approach may have language-specific biases. Considering the above problems, in this paper, we construct a Chinese–Uyghur cross-lingual sentence similarity dataset and propose a method to compute cross-lingual sentence similarity by fusing multiple features. The method is based on the cross-lingual pretraining model XLM-RoBERTa and assists the model in similarity calculation by introducing two coarse-grained prior knowledge features, i.e., sentence sentiment and length features. At the same time, to eliminate possible language-specific biases in the vectors, we whitened the sentence vectors of different languages to ensure that they were all represented under the standard orthogonal basis. Considering that the combination of different vectors has different effects on the final performance of the model, we introduce different vector features for comparison experiments based on the basic feature splicing method. The results show that the absolute value feature of the difference between two vectors can reflect the similarity of two sentences well. The final F1 value of our method reaches 98.97%, which is 19.81% higher than that of the baseline.

Sentences Similarity Model Based on Fusion of Semantic, Syntactic and Word Order Multi-Features

Sentence similarity computing based on multi-features fusion

Chinese Sentence Similarity Computational Model Based on Multi-Features Combination

Model for Sentence Similarity Computing Based on Multi-Features Combination

A Model for Chinese Sentence Similarity Computing

Semantic Similarity Computing Model Based on Multi Model Fine-Grained Nonlinear Fusion

Sentence Similarity Model Based on Semantics and Syntax

Chinese Sentence Similarity Based on Multi-feature Combination

A Cross-Lingual Sentence Similarity Calculation Method with Multifeature Fusion

Improved Chinese Sentence Semantic Similarity Calculation Method Based on Multi-Feature Fusion

Convolutional Network-Based Semantic Similarity Model of Sentences

Sentence Similarity Based on Semantic Vector Model.

Sentence Pair Similarity Modeling Based on Weighted Interaction of Multi-semantic Embedding Matrix

Fusing Syntax and Word Embedding Knowledge for Measuring Semantic Similarity

A Novel Sentence Similarity Model with Word Embedding Based on Convolutional Neural Network.

Sentence Similarity Computation Based on Feature Set

A Joint Model for Sentence Semantic Similarity Learning

Hybridization between Neural Computing and Nature-Inspired Algorithms for a Sentence Similarity Model Based on the Attention Mechanism

MNet-Sim: A Multi-layered Semantic Similarity Network to Evaluate Sentence Similarity

Sentence Similarity Computational Model Based on Information Content.

A measure of sentence similarity based on N-grams and Vector Space Model