Abstract:The text similarity calculation plays a crucial role as the core work of artificial intelligence commercial applications such as traditional Chinese medicine (TCM) auxiliary diagnosis, intelligent question and answer, and prescription recommendation. However, TCM texts have problems such as short sentence expression, inaccurate word segmentation, strong semantic relevance, high feature dimension, and sparseness. This study comprehensively considers the temporal information of sentence context and proposes a TCM text similarity calculation model based on the bidirectional temporal Siamese network (BTSN). We used the enhanced representation through knowledge integration (ERNIE) pretrained language model to train character vectors instead of word vectors and solved the problem of inaccurate word segmentation in TCM. In the Siamese network, the traditional fully connected neural network was replaced by a deep bidirectional long short-term memory (BLSTM) to capture the contextual semantics of the current word information. The improved similarity BLSTM was used to map the sentence that is to be tested into two sets of low-dimensional numerical vectors. Then, we performed similarity calculation training. Experiments on the two datasets of financial and TCM show that the performance of the BTSN model in this study was better than that of other similarity calculation models. When the number of layers of the BLSTM reached 6 layers, the accuracy of the model was the highest. This verifies that the text similarity calculation model proposed in this study has high engineering value.

A Novel Discrimination Structure for Assessing Text Semantic Similarity

Improving Text Semantic Similarity Modeling through a 3D Siamese Network

A Chinese Short Text Similarity Method Integrating Sentence-Level and Phrase-Level Semantics

A hybrid approach of Poisson distribution LDA with deep Siamese Bi-LSTM and GRU model for semantic similarity prediction for text data

Semantic Similarity Computing Model Based on Multi Model Fine-Grained Nonlinear Fusion

MNet-Sim: A Multi-layered Semantic Similarity Network to Evaluate Sentence Similarity

Attentive Siamese LSTM Network for Semantic Textual Similarity Measure

Traditional Chinese Medicine Text Similarity Calculation Model Based on the Bidirectional Temporal Siamese Network

Comparison study of using semantic and syntactic network characteristics to do text clustering

Hybrid Attention Based Neural Architecture for Text Semantics Similarity Measurement

Interactive Self-Attentive Siamese Network for Biomedical Sentence Similarity

A Novel Linguistic Phenomenon Description for Text Similarity Computing

A Chinese Short Text Similarity Algorithm Based on Semantic and Syntax

A Combined Measure for Text Semantic Similarity

Similarity algorithm of text based on semantic understanding

Short Text Similarity Calculation Based on Jaccard and Semantic Mixture

Assessing similarities between spatial point patterns with a Siamese neural network discriminant model

Research on Chinese Semantic Similarity Algorithm

A novel locality-sensitive hashing relational graph matching network for semantic textual similarity measurement

A survey on the techniques, applications, and performance of short text semantic similarity

Similarity-based Text Recognition by Deeply Supervised Siamese Network