Abstract:Cross-language sentence similarity computation is among the focuses of research in natural language processing (NLP). At present, some researchers have introduced fine-grained word and character features to help models understand sentence meanings, but they do not consider coarse-grained prior knowledge at the sentence level. Even if two cross-linguistic sentence pairs have the same meaning, the sentence representations extracted by the baseline approach may have language-specific biases. Considering the above problems, in this paper, we construct a Chinese–Uyghur cross-lingual sentence similarity dataset and propose a method to compute cross-lingual sentence similarity by fusing multiple features. The method is based on the cross-lingual pretraining model XLM-RoBERTa and assists the model in similarity calculation by introducing two coarse-grained prior knowledge features, i.e., sentence sentiment and length features. At the same time, to eliminate possible language-specific biases in the vectors, we whitened the sentence vectors of different languages to ensure that they were all represented under the standard orthogonal basis. Considering that the combination of different vectors has different effects on the final performance of the model, we introduce different vector features for comparison experiments based on the basic feature splicing method. The results show that the absolute value feature of the difference between two vectors can reflect the similarity of two sentences well. The final F1 value of our method reaches 98.97%, which is 19.81% higher than that of the baseline.

A Korean Sentence Similarity Calculation Method Based on Sub-Word Level Information

Sentence similarity computing based on relation vector model

A Novel Sentence Similarity Model with Word Embedding Based on Convolutional Neural Network.

A measure of sentence similarity based on N-grams and Vector Space Model

A Model for Chinese Sentence Similarity Computing

SSF: Sentence Similar Function Based on Word2vector Similar Elements

Cross-lingual Documents Similarity Measure Based on Co-occurrence Mapping Between Chinese,English and Korean

CHINESE SHORT SENTENCE SIMILARITY CALCULATION BASED ON TREE-STRUCTURE CORPUS

Research on Sentence Semantic Similarity Calculation Based on Word2vec

ON AUTOMATIC ABSTRACTING ALGORITHM BASED ON OPTIMISED SENTENCES SIMILARITY CALCULATION

Sentence Similarity Based on Semantic Vector Model.

A Cross-Lingual Sentence Similarity Calculation Method with Multifeature Fusion

Sentence Similarity Model Based on Semantics and Syntax

MNet-Sim: A Multi-layered Semantic Similarity Network to Evaluate Sentence Similarity

Method of Sentence Similarity Calculation for Intelligent Customer Service

A New Method For Chinese Sentence Similarity Computing And Its Weighting Coefficients Determination

A Word Similarity Calculation Method Based on CSD and Statistics

An Improved Method of Computing Chinese Sentence Similarity

Chinese Sentence Similarity Measure Based on Words and Structure Information

A Chinese Short Text Similarity Method Integrating Sentence-Level and Phrase-Level Semantics

Sentence Similarity Computational Model Based on Information Content.