Abstract:Semantic text matching is one of the most important research problems in many domains, including, but not limited to, information retrieval, question answering, and recommendation. Among the different types of semantic text matching, long-document-to-long-document text matching has many applications, but has rarely been studied. Most existing approaches for semantic text matching have limited success in this setting, due to their inability to capture and distill the main ideas and topics from long-form text. In this paper, we propose a novel Siamese multi-depth attention-based hierarchical recurrent neural network (SMASH RNN) that learns the long-form semantics, and enables long-form document based semantic text matching. In addition to word information, SMASH RNN is using the document structure to improve the representation of long-form documents. Specifically, SMASH RNN synthesizes information from different document structure levels, including paragraphs, sentences, and words. An attention-based hierarchical RNN derives a representation for each document structure level. Then, the representations learned from the different levels are aggregated to learn a more comprehensive semantic representation of the entire document. For semantic text matching, a Siamese structure couples the representations of a pair of documents, and infers a probabilistic score as their similarity. We conduct an extensive empirical evaluation of SMASH RNN with three practical applications, including email attachment suggestion, related article recommendation, and citation recommendation. Experimental results on public data sets demonstrate that SMASH RNN significantly outperforms competitive baseline methods across various classification and ranking scenarios in the context of semantic matching of long-form documents.

A Survey of State-of-the-Art Short Text Matching Algorithms.

A Survey of Text-Matching Techniques

A Survey on Deep Text Matching

Deep Learning for Text Matching: A Survey

A survey on the techniques, applications, and performance of short text semantic similarity

Analysis of the text matching problem

aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model

Text Matching As Image Recognition

Multiresolution Graph Attention Networks for Relevance Matching

Syntax-based Deep Matching of Short Texts

A simple and efficient text matching model based on deep interaction

A Short-Text Similarity Model Combining Semantic and Syntactic Information

The Short Text Matching Model Enhanced with Knowledge via Contrastive Learning

Short Text Semantic Matching Model Based on Bert and Adversarial Network.

Simple and Effective Text Matching with Richer Alignment Features

A Study of MatchPyramid Models on Ad-hoc Retrieval.

Text Matching With Monte Carlo Tree Search

Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding

Semantic Text Matching for Long-Form Documents

DEEP LEARNING FOR SEMANTIC MATCHING: A SURVEY