Abstract:Semantic matching of natural language sentences or identifying the relationship between two sentences is a core research problem underlying many natural language tasks. Depending on whether training data is available, prior research has proposed both unsupervised distance-based schemes and supervised deep learning schemes for sentence matching. However, previous approaches either omit or fail to fully utilize the ordered, hierarchical, and flexible structures of language objects, as well as the interactions between them. In this paper, we propose Hierarchical Sentence Factorization---a technique to factorize a sentence into a hierarchical representation, with the components at each different scale reordered into a "predicate-argument" form. The proposed sentence factorization technique leads to the invention of: 1) a new unsupervised distance metric which calculates the semantic distance between a pair of text snippets by solving a penalized optimal transport problem while preserving the logical relationship of words in the reordered sentences, and 2) new multi-scale deep learning models for supervised semantic training, based on factorized sentence hierarchies. We apply our techniques to text-pair similarity estimation and text-pair relationship classification tasks, based on multiple datasets such as STSbenchmark, the Microsoft Research paraphrase identification (MSRP) dataset, the SICK dataset, etc. Extensive experiments show that the proposed hierarchical sentence factorization can be used to significantly improve the performance of existing unsupervised distance-based metrics as well as multiple supervised deep learning models based on the convolutional neural network (CNN) and long short-term memory (LSTM).

Efficient Algorithm for Sentence Information Content Computing in Semantic Hierarchical Network

An Information Content-Based Approach for Measuring Concept Semantic Similarity in WordNet

A New Hypred Improved Method for Measuring Concept Semantic Similarity in WordNet.

A Novel Comprehensive Approach for Estimating Concept Semantic Similarity in WordNet

Vector Semantic Computing Method Study for Short Sentence

Matching Natural Language Sentences with Hierarchical Sentence Factorization

Statistical Properties of Chinese Semantic Networks

Chinese Word Similarity Computing Based on Semantic Tree

Comparison study of using semantic and syntactic network characteristics to do text clustering

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Semantic Similarity Computing Model Based on Multi Model Fine-Grained Nonlinear Fusion

SCHAIN-IRAM: An Efficient and Effective Semi-Supervised Clustering Algorithm for Attributed Heterogeneous Information Networks

MNet-Sim: A Multi-layered Semantic Similarity Network to Evaluate Sentence Similarity

Scalable Models for Computing Hierarchies in Information Networks

Sentence Similarity Computation by Integrating Shallow and Deep Information

Semantic Sentence Matching with Densely-Connected Recurrent and Co-Attentive Information

Semantic Similarity Analysis via Syntax Dependency Structure and Gate Recurrent Unit

Hierarchical Graph Semantic Pooling Network for Multi-modal Community Question Answer Matching

Semantic Correlation Network Based Text Clustering

Semi-supervised Clustering in Attributed Heterogeneous Information Networks

Sentence-Embedding and Similarity via Hybrid Bidirectional-LSTM and CNN Utilizing Weighted-Pooling Attention